Functions
construct_attention_mask
Constructs attention masks based on the provided input_key in the datadict.
previous
cerebras.modelzoo.data_preparation.data_preprocessing.tokenflow.tokenizer.GenericTokenizer
next
cerebras.modelzoo.data_preparation.data_preprocessing.tokenflow.utils.construct_attention_mask