logoalt Hacker News

orbital-decay • yesterday at 9:55 PM • 2 replies • view on HN

The classifier is separate from the model and it's not capable of any of that nuance, it's just tuned to reject anything looking like a CoT jailbreak and not care about false positives. (which is funny because there still are easy ways to leak the raw CoT and train on it to your heart's content)


Replies

belluxx • yesterday at 10:19 PM

Do you have some resources to link on the easy ways you mentioned?

Barbing • today at 1:02 AM

> easy ways to leak the raw CoT

At scale?