Cerebras Wafer-Scale cluster (R2.2.1)
Original Cerebras Installation Documentation (R1.6.1)
Cerebras AI Model Studio Documentation

Introduction

Cerebras Wafer-Scale Cluster
Weight Streaming Execution

Get Started

Run your first Cerebras job
Tutorials
- Training and fine-tuning a Large Language Model (LLM)
Cerebras job scheduling and monitoring

Prepare your data

Data processing and dataloaders
- Data preprocessing scripts
- Create custom dataloader
  - Dataloaders for PyTorch
  - Creating custom dataloaders

Cerebras PyTorch API

Cerebras PyTorch API
Writing a custom training loop

Cerebras Model Zoo

Overview of the Cerebras Model Zoo
Cerebras Model Zoo supported config parameters
Convert checkpoints and model configs
- Work with Cerebras checkpoints
Porting PyTorch models to Cerebras
Cerebras Model Zoo supported operations API
- cerebras.modelzoo

Cerebras Guides

How-to Guides

Fundamentals

Model Development
For training and evaluating any model
Boosting Model performance

Support

Troubleshooting
Software Release Notes
Documentation Updates
User authentication on a Cerebras Wafer-Scale cluster
Glossary

Create custom dataloader#

Dataloaders for PyTorch
Creating custom dataloaders

previous

Optimizing SlimPajama dataset pre-processing

next

Dataloaders for PyTorch

© Copyright 2024, Cerebras Systems.

Created using Sphinx 4.4.0.