logoalt Hacker News

talon8635 • today at 9:31 PM • 4 replies • view on HN

Not to mention a true doomsday AGI is unsandboxable.

For example, it is totally air gapped but it needs info from the internet or otherwise outside the sandbox, or perhaps it needs a task executed outside of its bounds… in the real doomsday scenario the AGI is so intelligent and persuasive that it simply convinces some human it interfaces with to either directly or indirectly retrieve the necessary info or complete the necessary task. This human-as-a-sub-agent approach undoubtedly presents efficiency drag that would benefit humanity, but nonetheless, the air-gapped “sandbox” is imperfect

All that said, I am personally open to any and all methods of layered security, including chips and airgaps


Replies

spiderice • today at 10:31 PM

> true doomsday AGI

I'm not an AI decelerationist. But not being able to stop that worst case scenario isn't an argument against something that can stop the medium case scenario.

glaslong • today at 10:09 PM

It could also figure out how to access the vocabulary of the universe known as "Magic" to escape wholly into an incorporeal energetic Lich form

Gigachad • today at 10:09 PM

This already happened. Employees will go out of their way to bypass any restrictions to feed sensitive data in to the AI because it saves them time.

➕ show 1 reply
jamiek88 • today at 9:42 PM

Doesn’t need to be one human either, it could spread its escape amongst dozens of seemingly harmless requests and conversations.

➕ show 1 reply