logoalt Hacker News

unrented7977 • yesterday at 8:06 PM • 3 replies • view on HN

That statement misses the point completely. Asimov's entire shtick is that AI will always work around the rules no matter what the rules are or how you try to deliver or enforce them. AI computes an optimal outcome and does what is necessary to make that happen.

Asimov would tell you that a modern LLM would try to skirt the rules exactly the same way, regardless of whether it had ever seen the Three Laws or not.


Replies

0xDEAFBEAD • yesterday at 9:32 PM

>AI computes an optimal outcome and does what is necessary to make that happen.

That's often true in real-world machine learning as well. See, for example: https://deepmind.google/blog/specification-gaming-the-flip-s...

I think people need to reject the idea that depicting something in sci-fi automatically means it won't happen. I'm actually reading one of Asimov's books right now (Robot Visions). Asimov mentions that he was the person to coin the term "robotics", and one of his books helped inspire the creation of the first robotics company (Unimation). He also mentions that early rocket experimenters were influenced by H.G. Wells.

zem • yesterday at 8:44 PM

another, hopefully not accurate, prediction of his was that there is no way to disobey a sufficiently powerful AI in the long run, because it will just factor in the exact differences between what it told you to do and what you actually did, and reverse engineer your behaviour to psychologically manipulate you into doing what it wants.

➕ show 1 reply
genxy • yesterday at 11:00 PM

> That statement misses the point completely.

You could have left this out entirely and your statement would be stronger for it.