cerebras.modelzoo.data.nlp.transformer.TransformerDynamicDataProcessor#

Processor for PyTorch Transformer training.

Classes

TransformerDynamicDataProcessor

Reads text files containing the input text tokens.

TransformerDynamicDataProcessorConfig

previous

cerebras.modelzoo.data.nlp.transformer

next

cerebras.modelzoo.data.nlp.transformer.TransformerDynamicDataProcessor.TransformerDynamicDataProcessor