logoalt Hacker News

adastra22 • today at 10:31 AM • 1 reply • view on HN

Why would you hold off evaluation criteria? This isn’t LLM training.


Replies

OJFord • today at 10:41 AM

It's similar: they don't want it designing an architecture that overfits to exactly their 25 evaluation workloads, it's supposed to be general purpose.