logoalt Hacker News

the_duke • today at 3:43 AM • 0 replies • view on HN

To be fair, a lot of the popular benchmarks have become pretty meaningless.

Models often get great scores despite being a lot worse than the frontier in practice.