Introduction
Get Started
Prepare your data
Cerebras PyTorch API
cerebras.pytorch
cerebras.pytorch.amp
cerebras.pytorch.optim
cerebras.pytorch.sparse
cerebras.pytorch.metrics
Cerebras Model Zoo
Cerebras Guides
Fundamentals
Support
Classes
NLGTokenGenerator
Token Generator for NLG data sets such as E2E, DART, and WebNLG.
previous
cerebras.modelzoo.data_preparation.nlp.chunk_data_processing.mlm_data_token_generator.MLMTokenGenerator
next
cerebras.modelzoo.data_preparation.nlp.chunk_data_processing.nlg_token_generator.NLGTokenGenerator