cerebras.modelzoo.data.nlp.t5.T5DynamicDataProcessor#

Processor for PyTorch T5 training.

Classes

T5DynamicDataProcessor

Reads text files containing the input text tokens, adds extra ids for language modeling task on the fly.

T5DynamicDataProcessorConfig

previous

cerebras.modelzoo.data.nlp.t5

next

cerebras.modelzoo.data.nlp.t5.T5DynamicDataProcessor.T5DynamicDataProcessor