cerebras.modelzoo.data_preparation.nlp.pubmed.Downloader.Downloader#

class cerebras.modelzoo.data_preparation.nlp.pubmed.Downloader.Downloader[source]#

Bases: object

Parameters

  • save_path – Location to download and extract the dataset

  • dataset – One of “pubmed_baseline”, “pubmed_daily_update”, “pubmed_fulltext”, “pubmed_open_access”

Extracts to save_path/extracted

Methods

download

download_files

extract_files

__init__(dataset, save_path)[source]#
Parameters

  • save_path – Location to download and extract the dataset

  • dataset – One of “pubmed_baseline”, “pubmed_daily_update”, “pubmed_fulltext”, “pubmed_open_access”

Extracts to save_path/extracted

previous

cerebras.modelzoo.data_preparation.nlp.pubmed.Downloader.parse_args

next

cerebras.modelzoo.data_preparation.nlp.pubmed.TextFormatting