cerebras.modelzoo.data.common.SyntheticDataProcessor

Utilities for generating synthetic data based on some specification.

Functions

custom_dict_flatten	Constructs TensorSpec instances to contain the leaf nodes of the tree structure before flattening.
custom_dict_unflatten	After mapping the TensorSpecs to tensors/callables, return them directly as leaf nodes instead of reconstructing a dictionary when unflattening.

Classes

SyntheticDataProcessor

Creates a synthetic dataset.

previous

cerebras.modelzoo.data.common.HDF5IterableDataset.RestartableDataLoader

next

cerebras.modelzoo.data.common.SyntheticDataProcessor.custom_dict_flatten