Tag
From the Glossary
Glossary
Fine-tuning — a scalpel, not a universal hammer
Fine-tuning changes model weights. It is powerful when you have data, evals and a clear reason. It is an expensive mistake when it hides a bad prompt, missing RAG or an unclear process.