Flashcard

LoRA (Low-Rank Adaptation)

LoRA injects small trainable low-rank matrices into layers while keeping original weights frozen.

Question

What is LoRA and how does it work?

Click to reveal answer