cerebras.modelzoo.data.nlp.bert.BertTokenClassifierDataProcessor.parse_ner_row#

cerebras.modelzoo.data.nlp.bert.BertTokenClassifierDataProcessor.parse_ner_row(data_row, do_lower=False)[source]#

Postprocessing of a row in the CSV file. :param: dict data_row: dictionary with an input text tokens and labels.

Returns

tuple: (list of parsed tokens, List of labels).

previous

cerebras.modelzoo.data.nlp.bert.BertTokenClassifierDataProcessor.create_ner_features

next

cerebras.modelzoo.data.nlp.bert.BertTokenClassifierDataProcessor.BertTokenClassifierDataProcessor