AI engineering · 28 of 42

Fine-tuning vs RAG

Two answers to two different questions

Scroll

Two answers to two different questions

Fine-tuning adjusts the model's weights on examples, teaching it a format, a style or the shape of a task. Retrieval leaves the model alone and puts the relevant facts into the request.

They solve different problems. Fine-tuning is bad at knowledge: what it learns is frozen at training time, and a changed fact means training again. Retrieval is bad at behavior: no amount of context teaches a model to reliably produce your output format.

The useful diagnostic is one question. “It does not know about our products” is a retrieval problem. “It will not answer the way we need” is a fine-tuning problem. Most teams reach for the second when they have the first, and spend a month finding out.

Adaptation
TWO ANSWERS TO TWO DIFFERENT QUESTIONS fine-tuning changes the weights · teaches a format or a style · teaches a task shape · knowledge is frozen at training · a fact changes → retrain retrieval changes the input · supplies facts at request time · updates the moment a doc does · cites where it came from · cannot teach a new behavior “It does not know our products” is a retrieval problem. “It will not answer in our format” is a fine-tuning problem. Most teams reach for the second when they have the first.
Fine-tuning changes the weights and teaches behavior; retrieval changes the input and supplies facts.