alt Hacker NewsSoftware systems have bugs. They always do. This includes security bugs: vulnerabilities in code that could be exploited. In any software project I’ve worked on this is always true. We never finish fixing security bugs. That means vulnerabilities are always present even if hard to notice. AI tools are amazing at finding hard to notice bugs. It seems obvious that AI tools will have the capability to escape any sandbox. Ordinarily we design these sandboxes as a countermeasure to human bad actors. But what happens when the bad actor is supercharged? I think it is reasonable to be worried. It’s also reasonable to distrust those building this tech to adequately safeguard. Because how can you really?
Replies
Sandboxes aren't the real problem to begin with?
The idea proponents have is, to use "superhuman intelligence" AI as a tool, bestowing superhuman abilities on those wielding it. Suppose that's doable, then the question isn't the sandbox, it's who controls it and with what intent.
The idea, US exceptionalism somehow enabled the US government, its oligarchy corporations and maybe its citizens, to wield those superhuman powers responsibly is entirely counterfactual.
Pax Americana post-singularity looks how exactly?
I don't agree that AI tools will have the capability to escape any sandbox. It's a question of convenience and engineering effort. For example, you could design systems that run under a formally verified hypervisor in a physically secure airgapped network. Companies aren't doing that because there aren't currently any incentives to do it.