logoalt Hacker News

prodigycorptoday at 2:31 PM0 repliesview on HN

Disagree. We are at the point where coming up with good evals for these models is extremely difficult. Solving unsolved math problems is a valid way of evaluating model progress and somewhat necessary to understand how far the current crop of models can go.