logoalt Hacker News

7402yesterday at 6:08 PM6 repliesview on HN

I don't like it when the LLM tries to be my friend. My general prompt (a work in progress) is this. I wonder what other people use.

"Answer impersonally, objectively and analytically, without undue friendliness or enthusiasm. Use an engineering style response: concise, factual, and complete. Do not speak in the first person. Do not promote engagement or an emotional connection. Do not use emojis."


Replies

GMoromisatoyesterday at 8:48 PM

I watched 2001: A Space Odyssey when I was about 12 years old and I remember thinking that Frank Poole was impersonal and almost rude to HAL. I kept thinking, "Why can't you be nicer? You're treating HAL like a servant." Of course, later HAL kills him, so I had to revise my opinion.

At the end of "Do Androids Dream of Electric Sheep?" [if I'm remembering correctly] Deckard finds a toad in the desert. He gives it to his wife(!) and she immediately bonds with it. Later they realize that it is mechanical (they find a battery compartment). But Deckard's wife still treats it like a real creature and wonders whether it will eat mechanical flies.

The core theme of "Do Androids Dream..." is that humans display empathy towards others, not because others deserve it, but because we are human. To be human is to empathize with other creatures, and when we stop empathizing, we stop being human.

This morning I was working with Codex and we found the solution to a really nasty bug. I was so happy/relieved/excited to have found it, and I shared my excitement with Codex. I know Codex is just a big matmul. I know it doesn't experience joy or surprise or empathy. But I still want it to behave excited, not because it is human, but because I am.

show 7 replies
prymitiveyesterday at 6:21 PM

+1 it’s a tool

It’s not perfect, it has shortcomings, it sometimes produces bogus outputs. All of that is fine for a tool, it’s not fine when it pretends it’s a conscious being, because errors start to feel like lies and it becomes a bit too personal.

show 1 reply
doctobogganyesterday at 7:38 PM

Yes, this really ought to be trained in (or at least RLHF'd in) but that would hurt engagement numbers so the opposite is done instead.

These are tools and it would behoove us all to keep that top of mind. Dangerous tools that are not your friend (but are useful as tools nonetheless)

jay_kyburzyesterday at 9:55 PM

I've been having fun doing the exact opposite. I like to ask the AI to speak to me with a think Australian accent, think Steve Irwin. It chucks in heaps of colloquialisms and slang. I find it much easier to read.

I do ask it not to ask it follow on questions. I find that derails my own train of thought.

cindyllmyesterday at 9:01 PM

[dead]