logoalt Hacker News

dwaltripyesterday at 9:57 PM0 repliesview on HN

LLMs have been trained to eagerly answer a user’s query.

They don’t reliably have the judgment to pause and proceed carefully if a delicate topic comes up. Hence these bandaids in the system prompt.