,,You can play this game of whack-a-mole indefinitely if the state of the system is concealed''

Not really as one of the main goals ofr ARC-AGI 3 was measuring task efficiency on unseen games.

I'm sure there are cheats everywhere but the most sensible thing is to just accept that the LLMs of today are much more intelligent in solving reasoning tasks than the ones from half year ago.

My own private benchmark shows the same thing.