Sets merge_weights=False in LoRA parameters. This is helpful during eval mode to ensure that the weights don’t get folded prior to checkpoint loading.
previous
cerebras.modelzoo.common.utils.model.lora
next
cerebras.modelzoo.common.utils.model.lora.get_lora_config_for_module