cerebras.modelzoo.data.nlp.gpt.DummyDataProcessor.DummyDataProcessor#

class cerebras.modelzoo.data.nlp.gpt.DummyDataProcessor.DummyDataProcessor(config)[source]#

Bases: cerebras.modelzoo.data.common.GenericDataProcessor.GenericDataProcessor

Methods

create_dataloader

Classmethod to create the dataloader object.
create_dataloader()#

Classmethod to create the dataloader object.

previous

cerebras.modelzoo.data.nlp.gpt.DummyDataProcessor

next

cerebras.modelzoo.data.nlp.gpt.DummyDataProcessor.DummyDataset