alt Hacker NewsThe AI vs AI security arms race is something that has been well predicted in genres like cyberpunk. It's fiction, but fiction grounded in reality.
First, we'd see this. Highly capable hacking AI with vast resources performing attacks against standard computing platforms that overwhelm human operators.
Second, human operators deploy capable adaptive protection AI to fend off AI attacks in realtime.
Then, the attacking AI partially switches from attacking programs to attacking protective AI.
The situation devolves to an arms race of tit-for-tat. You start seeing some protection AI running counter attacks against the attacking AI.
The escalations continue in complexity and speed to the point that almost all humans are left in the point of "wtf is going on".
Replies
> The escalations continue in complexity and speed to the point that almost all humans are left in the point of "wtf is going on".
Humans are paper clips long before that.
The problem is that, in this arms race, unaligned AI has a competitive advantage over aligned AI.
The second problem -- already seen in Ukraine v. Russia -- is that in a high-stakes situation, humans will take every safeguard off.
So you're saying it's probably time for me to just unplug the internet?
There’s a great and terrifying story by Stanislaw Lem about the endgame of an AI arms race called “The Invincible” [1]. It’s hard for me not to wonder whether AI run amok will play out to make the world uninhabitable more like Lem’s vision than The Terminator’s.
[1] https://en.wikipedia.org/wiki/The_Invincible