cerebras.modelzoo.data_preparation.nlp.transformer

create_meta	Create meta file for transformer in pytorch.
split_files	Split input src/tgt file into multiple files.

previous

cerebras.modelzoo.data_preparation.nlp.tokenizers.Tokenization.WordPieceTokenizer

next

cerebras.modelzoo.data_preparation.nlp.transformer.create_meta