cerebras.modelzoo.data.nlp.bert.BertTokenClassifierDataProcessor

Processor for PyTorch BERT fine tuning - Token classifier.

Functions

create_ner_features	Creates the features dict for token classifier model.
parse_ner_row	Postprocessing of a row in the CSV file.

Classes

BertTokenClassifierDataProcessor	Reads csv file containing the input token ids, and label_ids.
BertTokenClassifierDataProcessorConfig

previous

cerebras.modelzoo.data.nlp.bert.BertSumCSVDataProcessor.BertSumCSVDataProcessorConfig

next

cerebras.modelzoo.data.nlp.bert.BertTokenClassifierDataProcessor.create_ner_features