logoalt Hacker News

vonneumannstantoday at 2:10 PM1 replyview on HN

>Talking to the ARC folks tonight, it sounds like there will be an ARC-4,5,6,etc. I mean of course there will be.

Quintessential goal post moving...


Replies

mvkeltoday at 3:08 PM

If you read the charter of the eval (or any eval, really), this statement is pretty silly.

The whole point of each eval version is to identify a chunk of challenges that humans do well that AI can't. When AI gets to ~80, you move to the next chunk. When you run out of challenges, you have AGI.

show 1 reply