cerebras.modelzoo.data_preparation.data_preprocessing.data_preprocessor.update_progress#

cerebras.modelzoo.data_preparation.data_preprocessing.data_preprocessor.update_progress(pbar, progress_counter, total_chunks, data_stats, start_time, stop_event)[source]#

Update the progress bar based on the current progress.

Parameters
  • pbar (tqdm) – The progress bar instance.

  • progress_counter (Value) – A shared counter to track progress across processes.

  • total_chunks (int) – Total chunks to process.

  • start_time (float) – The start time of the process.

  • stop_event (Event) – Event to signal when to stop updating progress.

Returns

None

Return type

None