LoRA
Also: Low-Rank Adaptation
A technique for customizing an AI model without retraining the whole thing from scratch — which would be prohibitively expensive. LoRA adds small trainable layers on top of the existing model and only updates those. The result is a customized version of the model that is cheaper and faster to create. Relevant for developers building specialized AI tools; not something end users interact with directly.
In practice
You want to fine-tune an AI model on your company's specific writing style without the cost of full retraining. LoRA is a technique that adds small, trainable layers on top of the existing model and only updates those — dramatically reducing the compute and cost of customization. The result is a specialized model built on a fraction of what full fine-tuning would cost.
Related concepts