For training and evaluating any model

• Evaluate your model during training
  • Overview
  • Train and Eval Mode
  • Eval All Mode
  • Conclusion
• Summarize scalars and tensors
  • Overview
  • Scalar Summaries
  • Important considerations
  • Tensor Summaries
  • Conclusion
• Train with dynamic loss scaling
  • Overview
  • Supported precision
  • Configuration parameters
  • Procedure
  • Conclusion
• Running autoregressive inference
  • Overview
  • Preparing input data for autoregressive inference
  • Setting Inference Parameters
  • Running Autoregressive Inference
  • Accessing Inference Predictions
  • Conclusion
• Running Eleuther AI’s Evaluation Harness
  • Overview
  • Running Evaluation Harness on CS-X
  • Example
  • Supported Models
  • Supported Eval Harness Tasks
  • Adding New Tasks
  • Release Notes

previous

Special considerations for CV dataloaders

next

Evaluate your model during training