cerebras.modelzoo.data_preparation.nlp.hdf5_preprocessing.utils.update_params

cerebras.modelzoo.data_preparation.nlp.hdf5_preprocessing.utils.update_params(params, args)

Update config parameters with CLI arguments

previous

cerebras.modelzoo.data_preparation.nlp.hdf5_preprocessing.utils.truncate_or_pad_helper

next

cerebras.modelzoo.data_preparation.nlp.hdf5_preprocessing.utils.validate_tokens