modelzoo.transformers.data_processing.scripts.pubmed.preprocess.Downloader.Downloader#

class modelzoo.transformers.data_processing.scripts.pubmed.preprocess.Downloader.Downloader[source]#

Bases: object

Parameters

  • save_path – Location to download and extract the dataset

  • dataset – One of “pubmed_baseline”, “pubmed_daily_update”, “pubmed_fulltext”, “pubmed_open_access”

Extracts to save_path/extracted

Methods

download

download_files

extract_files

__init__(dataset, save_path)[source]#
Parameters

  • save_path – Location to download and extract the dataset

  • dataset – One of “pubmed_baseline”, “pubmed_daily_update”, “pubmed_fulltext”, “pubmed_open_access”

Extracts to save_path/extracted

previous

modelzoo.transformers.data_processing.scripts.pubmed.preprocess.Downloader.parse_args

next

modelzoo.transformers.data_processing.scripts.pubmed.preprocess.TextFormatting