Gemini 4 Argon is a new leader in Pareto-frontier. Looks like, Google is back in the race.
https://arena.ai/leaderboard/agent/chat/pareto
For almost same intelligence (+15.56%, +15.18%), drastic difference in cost/task ($3.51 vs $0.41)
> Gemini 4 Argon is a new leader in Pareto-frontier. Looks like, Google is back in the race.
For chat, yes. But switch to code on the same page, and the picture changes. OpenAI takes the lead.
Every release I see a new benchmark with a new frontier. These graphs are just meaningless now
Muse reminded me we should have a time based chart as well - this year I hope we will begin to see time to completion stats at various intelligence tiers. The waiting makes a lot of things more tiring.
Why do these benchmarks often show models running on Max i.e. Opus 5.5 (max) is on the frontier? I would think it is never really economical to run max