logoalt Hacker News

jansan • yesterday at 9:50 PM • 2 replies • view on HN

Why does Opus 5.5 immediately block when I enter this, even when explicitly say it is a quote that was written on Hackernews? What makes it allergic to that sentence?


Replies

orbital-decay • yesterday at 9:55 PM

The classifier is separate from the model and it's not capable of any of that nuance, it's just tuned to reject anything looking like a CoT jailbreak and not care about false positives. (which is funny because there still are easy ways to leak the raw CoT and train on it to your heart's content)

➕ show 2 replies
Barbing • yesterday at 9:54 PM

Not sure more mitigation time has been spent on anything by Anthropic than anti-distillation.