logoalt Hacker News

numpad0today at 12:08 AM1 replyview on HN

I wonder if "no one says no" culture is practically the same thing as instructing LLMs to always hallucinate.

You know, LLM hallucination is a phenomenon where the AI would generate syntactically bulletproof chunks of text that are not grounded in reality. Lots of efforts by frontier LLM labs had been made in past few years to solve this by enabling AIs to refute premises in the prompt.

Ordinary people still need to be instructed to google stuffs. They don't go to a niche de facto non-American social media to be disappointed by its notoriously bad search to then conclude its notoriously dumb AI can be abused as a makeshift search tool. People are simply unable.

Twitter has been doing so much things backwards lately. That's reminiscent of how hallucination hurts whatever you do with AIs.


Replies

aboardRat4today at 7:18 AM

Hallucination is not something specific to LLM by any means.

Remember when you were a kid, your teacher probably told you "At an exam, leave no question unanswered, even if you don't know what to write. Nobody is penalised for wrong answers, but even total gibberish might sometimes add a half-point to your score".