cerebras.modelzoo.common.utils.model.lora.LoRALayer#

class cerebras.modelzoo.common.utils.model.lora.LoRALayer[source]#

Bases: object

Base LoRA layer From https://github.com/microsoft/LoRA/blob/main/loralib/layers.py.

Methods

__init__(r: int, lora_alpha: int, lora_dropout: float, merge_weights: bool)[source]#

previous

cerebras.modelzoo.common.utils.model.lora.make_model_lora_helper

next

cerebras.modelzoo.common.utils.model.lora.LoRA_Embedding