cerebras.modelzoo.data_preparation.nlp.slimpajama.dedup.to_hash.to_minhash

cerebras.modelzoo.data_preparation.nlp.slimpajama.dedup.to_hash.to_minhash(chunks)

previous

cerebras.modelzoo.data_preparation.nlp.slimpajama.dedup.to_hash.output_results

next

cerebras.modelzoo.data_preparation.nlp.slimpajama.main