cerebras.modelzoo.common.utils.model.lora.LoRA_Embedding#

class cerebras.modelzoo.common.utils.model.lora.LoRA_Embedding(*args, **kwargs)[source]#

Bases: torch.nn.Embedding, cerebras.modelzoo.common.utils.model.lora.LoRALayer

LoRA embedding layer From https://github.com/microsoft/LoRA/blob/main/loralib/layers.py.

Methods

`forward`
`reset_parameters`
`train`

previous

cerebras.modelzoo.common.utils.model.lora.LoRALayer

next

cerebras.modelzoo.common.utils.model.lora.LoRA_Linear