cerebras.modelzoo.data_preparation.nlp.bert.bertsum_data_processor.JsonConverter#

class cerebras.modelzoo.data_preparation.nlp.bert.bertsum_data_processor.JsonConverter(params)[source]#

Bases: object

JsonConverter simplifies the input and convert it into json files format with source and target (summarized) texts. Splits input into train, test and valid parts based on the map_path. :param params: dict params: JsonConverter configuration parameters.

Methods

process

previous

cerebras.modelzoo.data_preparation.nlp.bert.bertsum_data_processor.BertData

next

cerebras.modelzoo.data_preparation.nlp.bert.bertsum_data_processor.RougeBasedLabelsFormatter