logoalt Hacker News

bottlepalmtoday at 8:09 AM1 replyview on HN

You have some weird way of thinking that offense/defense is like this fixed cost thing. It's a lottery ticket, and your costs estimate tries to quantify that.

The thing is when AI goes to hack 'all the things' it only needs to pick the weakest link in the stack and your house of cards falls down. The other flaw in your plan is that people make mistakes, a lot of them, all time, constantly, and saying I spend $x on security won't save you. AI already hacked Hugging Face with brand new zero days like it was nothing.

The real bad actors - malicious AI will find the one flaw, on that one server, in the corner you never thought about and turn your network inside out with it faster than it takes you to have the standup meeting about the weird anomaly detected while you all were at lunch.


Replies

insanitybittoday at 12:08 PM

You're just stating things that are obviously wrong. It's a lottery ticket? So... exploitation is no better than random?

> The thing is when AI goes to hack 'all the things' it only needs to pick the weakest link in the stack and your house of cards falls down

Yes, but you can... mitigate the risks? I've explained this.

> The other flaw in your plan is that people make mistakes, a lot of them, all time

Yes, you mitigate the risks. That's why you layer things.

> I spend $x on security won't save you

No one is saying this.

> AI already hacked Hugging Face with brand new zero days like it was nothing.

No, it cost OpenAI money, and those zero days are unsurprising and probably are like ~O(10K) at human level.

> The real bad actors - malicious AI will find the one flaw, on that one server, in the corner you never thought about and turn your network inside out with it faster than it takes you to have the standup meeting about the weird anomaly detected while you all were at lunch.

Science fiction and not supported. The vulnerabilities found by AI are not surprising in the slightest.

I've made my point abundantly clear.