How much data do you need to fine tune a model?
Depends what you change. Format or style, few hundred rows is often enough. A task the model already half knows, few thousand.
New facts is where people waste a week. The model comes back wrong in a new way. Use RAG for facts.
[flagged]
alt Hacker News
Depends what you change. Format or style, few hundred rows is often enough. A task the model already half knows, few thousand.
New facts is where people waste a week. The model comes back wrong in a new way. Use RAG for facts.