logoalt Hacker News

Art9681today at 7:49 PM1 replyview on HN

They cherrypicked benchmarks. The ONE weighed benchmark where is beats Opus5 by 0.1 points is what was linked because that's how propaganda works. The Agentic Index that includes the full benchmark suite has it in 5th place.

Might as well use gpt-sol.


Replies

iAMkenoughtoday at 9:05 PM

The whole industry cherry picks benchmarks.

I stopped paying attention to self-published benchmarks when Apple started using those non-sensical performance graphs with "relative performance" as a vertical axis when announcing a new chip.