Finetuning

Adapting Foundation Models for specific tasks.

When to Finetune

DO Finetune

• Improve quality on specific domain
• Reduce latency (smaller model)
• Reduce cost (fewer tokens)
• Ensure consistent style
• Add specialized capabilities

DON'T Finetune

• Prompt engineering is enough
• Insufficient data (<1000 examples)
• Need frequent updates
• RAG can solve the problem