cerebras.modelzoo.data_preparation.huggingface.CSDataCollatorForLanguageModeling.CSDataCollatorForLanguageModeling#

class cerebras.modelzoo.data_preparation.huggingface.CSDataCollatorForLanguageModeling.CSDataCollatorForLanguageModeling[source]#

Bases: transformers.DataCollatorForLanguageModeling

Overrides DataCollatorForLanguageModeling from HF to shift the inputs/labels in the dataloader

Methods

torch_call

__call__(*args: Any, **kwargs: Any) → Any#

Call self as a function.

__init__(*args: Any, **kwargs: Any) → None#
static __new__(cls, *args: Any, **kwargs: Any) → Any#

previous

cerebras.modelzoo.data_preparation.huggingface.CSDataCollatorForLanguageModeling

next

cerebras.modelzoo.data_preparation.huggingface.HF_converter_example_BookCorpus