logoalt Hacker News

throw10920today at 8:14 PM0 repliesview on HN

> Building a new benchmark won’t solve the problem, either.

It will if the benchmark is proprietary. If you can't train on it, then it's extremely difficult to game, and if it's hard enough, then it's economically more efficient to just...make the model smarter