ChatGPT has taken to saying things like “What I would do now is…” or “if I were you I’d…”.
I know these are figures of speech, but it reminds me that this thing doesn’t do anything, it doesn’t learn anything, it can’t try anything and find out. And yet it uses speech patterns drawn from real humans who can and do all those things.
Listen! And understand. That terminator is out there. It can't be bargained with. It can't be reasoned with. It doesn't feel pity, or remorse, or fear. And it absolutely will not stop, ever, until you are dead!
Claude does that too. “That always confuses me” or “I usually realize”.
Not only do these imply that the thing has a personality and preference, but also continuity and a life outside the chat window.
I had to add an explicit instruction not to impersonate a human, it was just too weird for me.
I've noticed it commonly uses phrasing like "that's usually the next step" when I'm using it to design something that I can't find an existing implementation of.
When I ask it to tweak recipes and stuff, it frequently says stuff like "my favorite way to..." or "I really like [x]".
I have a viscerally negative reaction to a machine claiming it has a favorite anything.
I wonder why, out of the many things models definitely can't do, you choose "try" and "find out". Surely every time it proposes a solution and then gets possibly corrected by the human minder its "trying something out" and surely it can use tools like web search and code execution to "find out" stuff?
I only use it sporadically, but I am always irked by it saying things like "I personally like to..." or "I prefer...". It does it so often, that I am convinced it's part of the system prompt.
> it can’t try anything and find out
Talk to an agent. It definitely learns things. Maybe not the taste of strawberry but about what is really going on in the software you are building with it.
How do you know that "real humans" do that and aren't simulacra? We know that it is physically possible to hook up a brain to simulated inputs, so perhaps you are simply living in a simulation.
I had claude throw something like "the last time I did <x>..." at me.
They seem to be trying to pump up the "humanity" to keep people engaged with it, which really backfires with me.