alt Hacker News"This is a classic test request..."
I know there's been discussion about whether pelicanmaxxing is happening, but this is at least evidence that Claude was explicitly exposed to this problem.
Replies
pgwhalen • today at 9:48 PM
It would be genuinely shocking at this point if any of the frontier models weren't well exposed to the problem.
simonw • today at 5:39 PM
See here for more discussion of that: https://news.ycombinator.com/item?id=49803892#49804881
➕ show 1 reply
0x10ca1h0st • today at 7:31 PM
Lets start frog riding motorcycle trend until they frogmaxx, or cat driving convertible.
cubefox • today at 5:48 PM
The model recognizing the task doesn't mean it was benchmaxxed (RLVR-trained) to solve it. It might simply recognize it from pre-training on Internet text.
Of course it was exposed - not sure it's explicit or not. Why wouldn't HackerNews comments be part of the training data? And Simon's blog and the many discussions about Pelicans? It'd be hard to miss. Doesn't mean Anthropic has made this an explicit goal in training.