Split input src file into multiple files. Number of examples per file is controlled by buffer_len param.
Functions
main
previous
cerebras.modelzoo.data_preparation.nlp.gptj.fine_tuning.continuous_pretraining
next
cerebras.modelzoo.data_preparation.nlp.gptj.split_trc_dataset.main