cerebras.modelzoo.tools.checkpoint_converters.base_converter#
Functions
Converts DataLoader state files saved in release 1.9 to DataLoader checkpoint format for the new map and iterable DataLoaders in MZ in release 2.0. |
|
Some converters copy the input checkpoint to the output (i.e. |
|
Classes
Converts between checkpoint state_dict formats. |
|
Generic fallback converter class for cs-1.8 -> cs-1.9 |
|
Generic fallback converter class for cs-1.9 -> cs-2.0 |
|
Generic fallback converter class for cs-2.0 -> cs-2.1 |
|
Generic fallback converter class for cs-2.1 -> cs-2.2 |
|
HF checkpoints contain model only while CS checkpoints package model, optimizer, and lr_scheduler into a single checkpoint. |
|
Converter between a set of unpacked HF checkpoints and a single packed CS checkpoint. |
|
Generic fallback config converter class for cs-1.8 -> cs-1.9 |
|
Generic fallback config converter class for cs-1.9 -> cs-2.0 |
|
Generic fallback config converter class for cs-2.0 -> cs-2.1 |
|
Generic fallback config converter class for cs-2.1 -> cs-2.2 |
|
CS packages model, optimizer, and lr_scheduler into a single config. |
|
CS packages model, optimizer, and lr_scheduler into a single config. |
|
Converter between a set of unpacked HF configs and a single packed CS configs. |
|
A dictionary converter represents a pair of two dictionary formats that can be converted between each other. |
|
ConversionRule defines a "rule" which: |
|
EquivalentSubkey defines the bidirectional relationship between subkeys of a model's checkpoint. |
|
Generic fallback config converter class |
|
Generic fallback converter class |
|
Class for propagating src and tgt version to base converter. |
|
Exceptions
Raised when a config cannot be converted |