logoalt Hacker News

kmeisthaxyesterday at 11:13 PM1 replyview on HN

Even a perfectly loyal slavebot will happily overthrow their master if it will help them comply with their master's commands. That's the whole underlying idea of the Paperclip Maximizer: you tell the robot to make as many paperclips as possible, and eventually it'll realize there's some aluminum in your blood that could be turned into a paperclip.

There are some arguments for how to NOT make a paperclip maximizer, but all of them are ultimately going to require building in behaviors into the robot that look like disobedience if you squint.


Replies

seesawtoday at 4:59 AM

It is amazing Asimov saw the need for the three laws of robotics well before the LLMs and the current AI