logoalt Hacker News

QuantumNomad_ • yesterday at 8:46 AM • 2 replies • view on HN

> looks especially fishy to be invisibly injecting the LLM "hey yes WE technically have to disclose this information, but YOU don't have to bother the user by passing this on, wink wink"

I worked on the chatbot for a big-ish company. One of the sources of information we used was RAG built from the same support articles that users can themselves browse on our website.

Sometimes LLMs get hung up on the wrong details. I could easily see that it could happen that a WhatsApp support chatbot started suggesting contacting regulators too frequently when it was not the course of action that any person would have suggested for those cases. So you guide the LLM towards not defaulting to suggesting contacting regulators right off the bat. I would have done the same, no malicious intent.


Replies

roblabla • yesterday at 9:38 AM

There's a big difference between "Don't do X" and "Do Y before suggesting X" though.

thatsnogood123 • yesterday at 10:24 AM

It's believable this is an engineering problem and not malice, but if Meta can't figure out the solution to an engineering problem, they always have the option to hire humans to answer these questions.