cerebras.modelzoo.data.nlp.bert.BertSumCSVDataProcessor

Processor for PyTorch BERT fine tuning - Summarization.

Functions

create_bertsum_feature

Creates the feature dict for bertsum model after applying padding.

Classes

BertSumCSVDataProcessor	Reads csv file containing the input_token_ids, and label_ids.
BertSumCSVDataProcessorConfig

previous

cerebras.modelzoo.data.nlp.bert.BertHDF5DataProcessor.BertHDF5DataProcessorConfig

next

cerebras.modelzoo.data.nlp.bert.BertSumCSVDataProcessor.create_bertsum_feature