logoalt Hacker News

oh_noyesterday at 5:41 PM1 replyview on HN

seeing a jump this big is not a great sign for the continuing value of a benchmark


Replies

modelessyesterday at 5:46 PM

It will continue to be valuable as a cost and speed benchmark long after it is saturated at the high end. And they are already working on ARC-AGI 4 and thinking about going even farther.