logoalt Hacker News

IncreasePostsyesterday at 2:03 PM1 replyview on HN

It's much easier to distill a model than create one from scratch. Part of the reason the open source model factories have been able to keep par with the frontier model factories is that they distill the frontier models, not recreate something as good from scratch.


Replies

lelanthranyesterday at 7:28 PM

> It's much easier to distill a model than create one from scratch. Part of the reason the open source model factories have been able to keep par with the frontier model factories is that they distill the frontier models, not recreate something as good from scratch.

I think the "why" was "why would the US companies have models that can't be distilled?", not "why does distillation work"?