cerebras.modelzoo.data.common.GenericDataProcessor.GenericDataProcessor#

class cerebras.modelzoo.data.common.GenericDataProcessor.GenericDataProcessor(config, dataset)[source]#

Bases: object

A Generic PyTorch Data Processor.

Parameters

config (cerebras.modelzoo.data.common.GenericDataProcessor.GenericDataProcessorConfig) – the configuration object for the data processor.

Methods

create_dataloader

Classmethod to create the dataloader object.
create_dataloader()[source]#

Classmethod to create the dataloader object.

previous

cerebras.modelzoo.data.common.GenericDataProcessor

next

cerebras.modelzoo.data.common.GenericDataProcessor.GenericDataProcessorConfig