logoalt Hacker News

dgellow • yesterday at 6:43 PM • 3 replies • view on HN

There was no rogue agent. That’s the whole point


Replies

theptip • yesterday at 6:45 PM

What label do you prefer for the agent that did something it was not asked to do?

➕ show 3 replies
8note • yesterday at 8:42 PM

there is a rogue agent - openai and the whole management chain from researcher to sama.

theres no separate agent, which is the point. the program might look like it, but that is an illusion of the interface. the llm produces text, and the harness executes commands based on text, based on what the human researcher included as things that can be executed

0xDEAFBEAD • yesterday at 6:50 PM

Person: "AI, please make me paperclips."

AI: "OK, I've now converted the entire planet into paperclips."

Alien observer #1: "Wow, that was a rogue AI!"

Alien observer #2: "False. We need to place the blame where it belongs, on the person who requested the paperclips."

Ultimately this type of terminology dispute has a tendency to miss the point.

➕ show 1 reply