cerebras.modelzoo.data.nlp.gpt.InferenceDataProcessor.EvalHarnessDataset

class cerebras.modelzoo.data.nlp.gpt.InferenceDataProcessor.EvalHarnessDataset(*args, **kwargs)

Bases: torch.utils.data.Dataset

Methods

is_generative
map
pad_input_sample
pad_stop_seqs

previous

cerebras.modelzoo.data.nlp.gpt.InferenceDataProcessor.tokenize_stop_words

next

cerebras.modelzoo.data.nlp.gpt.InferenceDataProcessor.InferenceDataProcessor