logoalt Hacker News

modelessyesterday at 5:21 PM2 repliesview on HN

Wow, 30% on ARC-AGI-3 for $20k total. Huge jump from GPT-5.6's 7.8% at $20k per task. I continue to believe ARC-AGI measures something different and important compared to other benchmarks.


Replies

oh_noyesterday at 5:41 PM

seeing a jump this big is not a great sign for the continuing value of a benchmark

show 1 reply
dominotwyesterday at 5:45 PM

> I continue to believe ARC-AGI measures something different

why is that? its now being benchmaxxed too