cerebras.modelzoo.data_preparation.nlp.t5.utils.parse_text#

cerebras.modelzoo.data_preparation.nlp.t5.utils.parse_text(text, do_lower)[source]#

Postprocessing of the CSV file. :param: str text: String with an input text.

Returns

List of parsed tokens.

previous

cerebras.modelzoo.data_preparation.nlp.t5.utils.pad_t5_input_features

next

cerebras.modelzoo.data_preparation.nlp.t5.utils.random_spans_noise_mask