cerebras.modelzoo.data.nlp.t5.T5DynamicDataProcessor

Processor for PyTorch T5 training.

Classes

T5DynamicDataProcessor

Reads text files containing the input text tokens, adds extra ids for language modeling task on the fly.

previous

cerebras.modelzoo.data.nlp.t5

next

cerebras.modelzoo.data.nlp.t5.T5DynamicDataProcessor.T5DynamicDataProcessor

Was this information helpful?

Thank you for your feedback!

Leave Feedback

MESSAGE

May we contact you to discuss your comments?

• NO
• YES

Cancel Submit

Thank you for your feedback!