cerebras.modelzoo.data.nlp.bert.BertCSVDynamicMaskDataProcessor#

Processor for PyTorch BERT training.

Classes

BertCSVDynamicMaskDataProcessor

Reads csv files containing the input text tokens, adds MLM features on the fly.

BertCSVDynamicMaskDataProcessorConfig

previous

cerebras.modelzoo.data.nlp.bert.BertCSVDataProcessor.BertCSVDataProcessorConfig

next

cerebras.modelzoo.data.nlp.bert.BertCSVDynamicMaskDataProcessor.BertCSVDynamicMaskDataProcessor