cerebras.modelzoo.data_preparation.nlp.extractive_summarisation_utils#

Classes

BertCSVFormatter

Converts input into bert format, sets extractive summarization targets based on the rouge score between references and input sentences.

BertInputFeatures

BertInputFeatures(input_token_ids, labels, segment_ids, cls_ids)

previous

cerebras.modelzoo.data_preparation.nlp.data_dedup.to_hash.to_minhash

next

cerebras.modelzoo.data_preparation.nlp.extractive_summarisation_utils.BertCSVFormatter