logoalt Hacker News

delillos • yesterday at 5:54 PM • 2 replies • view on HN

Those version numbers don't necessarily correspond to equal increases in "difficulty", though.


Replies

password54321 • yesterday at 6:05 PM

Correct, the benchmark became exponentially more difficult as it progressed from pattern matching puzzles to games.

JacobAsmuth • yesterday at 6:36 PM

Very true, the sharp increase in difficulty (as measured by human passrate plummeting from 1->2 and again from 2->3) gives an even more stark view of AI capabilities over time.