alt Hacker NewsI worked with Greg Brockman in the mid-2010s. Once, as we were walking down Folsom street, I explained Eliezer Yudkowsky's "AI Box" experiment to him[1].
He said something to the effect of "that's ridiculous - I would simply not let it out of the box."
We agreed to try it out some day, but never did.
Replies
yreg • yesterday at 7:22 PM
Maybe I'm leaning into scifi, but I believe that Yudkowsky is right that a sufficiently smart intelligence is uncontainable at all.
We can only hope to either never create an AI so strong or to align it correctly. But if it is not aligned and only “contained” then it won't ever be safe.
➕ show 1 reply
The thought experiment assumed one super intelligence, as opposed to many hundreds/thousands of midwits. Also he probably didn't expect the agent to credibly offer him a billion dollars, which is essentially what has happened.