logoalt Hacker News

modelessyesterday at 5:26 PM2 repliesview on HN

Yes, I think it indicates real progress in fluid intelligence. Clearly these models are making huge strides in usefulness which are well correlated with their ARC-AGI scores.

I don't think this is benchmaxxing. These companies are locked in a competition to produce the best software engineer, and falling behind is an existential risk. I doubt they are wasting time benchmaxxing ARC-AGI.


Replies

wyreyesterday at 5:48 PM

If they were benchmaxxing, surely they would score higher than 30% on ARC-AGI.

show 1 reply
dominotwyesterday at 5:44 PM

nah they could make educated guess about arc and benchmaxx it too.