alt Hacker News*Personally I think today's frontier models can be beat by training from scratch. Haven't proved this yet tho*
On specific tasks sure on "generic performance" whatever that means for you not really.
*Personally I think today's frontier models can be beat by training from scratch. Haven't proved this yet tho*
On specific tasks sure on "generic performance" whatever that means for you not really.
As of today yes I agree with you
in the future, for general perf, I am optimistic that someone will figure out an alphazero like approach (ilya/silver/sutton/carmack seem to be working on something like this)