cerebras.modelzoo.common.utils.model.vocab_utils

Functions

get_vocab_size

Function to get vocab size and validate with vocabulary file.

previous

cerebras.modelzoo.common.utils.model.transformer_utils.smooth_loss

next

cerebras.modelzoo.common.utils.model.vocab_utils.get_vocab_size