logoalt Hacker News

stymaaryesterday at 10:15 PM1 replyview on HN

Sounds like “according John McAfee the threat of malware has been largely solved”.

Edit: it's way worse than that: the actual figures says that Mythos “only” falls for prompt injection 2.6% of the times. Maybe for an ML engineer used to work with unreliable tools that sounds impressive, but for security purpose having a system that fails every 40 attempts is outright catastrophic. Imagine if your OS vendor only patched known security holes in a way that still let an attacker go through every 40 attempts…

And we're just talking about known kind of prompt injection that are tracked by benchmarks, not any kind of 0-day vulnerability found by clever attackers.


Replies

andy99yesterday at 10:40 PM

They also don’t appear to consider false positives.

Pretty famously, false positives make some other Anthropic products unusable. If you treat them as zero cost it’s easy to drive down miss rate.