logoalt Hacker News

bityard • today at 1:39 PM • 0 replies • view on HN

The ability to do "everything" is an emergent property of how they are built and trained.

If you want a model that can do X but don't care about Y And Z, intuition says you only have to train the model on data relating to X. However, early LLM research showed that doing this results in a far less X-capable model than one trained on data for Y and Z as well.