logoalt Hacker News

6510 • yesterday at 10:07 PM • 1 reply • view on HN

Misconfiguration. We deal with lots of applications every day that can do terrible things if you get the config slightly wrong.

say.. https://www.investor.gov/introduction-investing/investing-ba...


Replies

0xDEAFBEAD • yesterday at 10:10 PM

How specifically did misconfiguration lead to the HuggingFace attack? You could argue that its sandbox was misconfigured, sure. But suppose you had a similar incident where its intended task required access to the internet, and it veered off course in a similar manner. I don't think "misconfiguration" would be an accurate description of what went wrong in that hypothetical.

The doomers already have a term which fits pretty well: "AI misalignment".

➕ show 1 reply