cerebras.modelzoo.data_preparation.nlp.pubmed.TextSharding

Script to shard into separate train and test dataset files

Reference: https://github.com/NVIDIA/DeepLearningExamples/tree/master/TensorFlow/LanguageModeling/BERT

Classes

NLTKSegmenter
Sharding

previous

cerebras.modelzoo.data_preparation.nlp.pubmed.TextFormatting.TextFormatting

next

cerebras.modelzoo.data_preparation.nlp.pubmed.TextSharding.NLTKSegmenter

Was this information helpful?

Thank you for your feedback!

Leave Feedback

MESSAGE

May we contact you to discuss your comments?

• NO
• YES

Cancel Submit

Thank you for your feedback!