cerebras.modelzoo.data_preparation.raw_dataset_processor.RawDatasetProcessor.MultimodalRawDatasetProcessorConfig

class cerebras.modelzoo.data_preparation.raw_dataset_processor.RawDatasetProcessor.MultimodalRawDatasetProcessorConfig(*args, **kwargs)

Bases: cerebras.modelzoo.data_preparation.raw_dataset_processor.RawDatasetProcessor.RawDatasetProcessorConfig

Multimodal Configuration class for RawDatasetProcessor.

Methods

check_for_deprecated_fields
check_literal_discriminator_field
copy
get_orig_class
get_orig_class_args
model_copy
model_post_init
post_init

Attributes

batch_size	The dataset preprocessing configuration.
discriminator
discriminator_value
drop_last
image_data_size	The final C x H x W shape of the image.
img_data_dir	The directory containing the image data.
model_config
num_workers
persistent_workers
prefetch_factor
preprocessing
seed
shuffle
shuffle_seed
transforms	List of transformations to apply to images.
data_processor

image_data_size = Ellipsis

The final C x H x W shape of the image.

transforms = Ellipsis

List of transformations to apply to images.

img_data_dir = Ellipsis

The directory containing the image data.

previous

cerebras.modelzoo.data_preparation.raw_dataset_processor.RawDatasetProcessor.MultimodalRawDatasetProcessor

next

cerebras.modelzoo.data_preparation.raw_dataset_processor.RawDatasetProcessor.RawDatasetProcessor