cerebras.modelzoo.data.nlp.gpt.HuggingFaceDataProcessorEli5#

Pytorch HuggingFace Eli5 map-style Dataloader

Classes

HuggingFaceDataProcessorEli5

A HuggingFace Eli5 map-style Data Processor.

HuggingFaceDataProcessorEli5Config

previous

cerebras.modelzoo.data.nlp.gpt.GptHDF5DataProcessor.GptHDF5DataProcessor

next

cerebras.modelzoo.data.nlp.gpt.HuggingFaceDataProcessorEli5.HuggingFaceDataProcessorEli5