LoRA

Fine-tuning and LoRA: teaching an old model a new job without retraining it Lesson

You almost never train an AI from scratch. You take one that already knows language and nudge it toward your specific task - and a trick called LoRA lets you do that by adding a tiny sticky note instead of rewriting the whole brain.