cerebras.modelzoo.data_preparation.utils.split_list#

cerebras.modelzoo.data_preparation.utils.split_list(l, n)[source]#

Splits list/string into n sized chunks.

Parameters

  • l (List[str]) – List or string to split.

  • n (int) – Number of chunks to split to.

Returns List[List]

List of lists containing split list/string.

previous

cerebras.modelzoo.data_preparation.utils.pad_instance_to_max_seq_length

next

cerebras.modelzoo.data_preparation.utils.text_to_tokenized_documents