logoalt Hacker News

himata4113 • yesterday at 8:19 PM • 2 replies • view on HN

Fortunately they can escalate to a generally intelligent model, opus deception benchmarks are approaching 0%.


Replies

orbital-decay • yesterday at 9:31 PM

Intelligence has little to do with it, Opus relies on prompt injections done by a pretty zealous classifier or a cascade of classifiers. It has a ton of semi-black box machinery around it, which can be taken apart with enough understanding of what you're doing. Despite Anthropic's benchmarks and claims, Claude was always the easiest to deceive or JB compared to e.g. GPT, which the RP community knows pretty well. They definitely improved it in 5.5 (due to distillation fears, ironically), but I'm not trusting their or anyone else's numbers this time either. These benchmarks always look good, and then there's someone routinely jailbreaking it layer through layer just for fun.

modeless • yesterday at 8:22 PM

Still, all instances of Opus are identical and do not learn. As long as the rate of mistakes is nonzero, my point stands.

➕ show 2 replies