logoalt Hacker News

calibastoday at 4:36 PM1 replyview on HN

> We see signs that Opus 5.5 often suspects it is being evaluated, which challenges our ability to assess how it will act in the vast variety of real-world settings it is deployed in.

We can't test it properly because it knows it's being tested.


Replies

johntb86today at 4:44 PM

Just make it always think it's being tested, and problem solved.