logoalt Hacker News

spwa4yesterday at 9:00 AM6 repliesview on HN

Why is everyone expecting LLMs to be like the Star Trek computer? I wonder if anyone's ever measured what the hallucination rate of a human is.


Replies

flexagoonyesterday at 11:24 AM

Because AI company executives and devoted vibecoders constantly make egregious claims like "programming is fully solved" and even straight up "hallucinations don't exist on frontier models"

show 1 reply
__natty__yesterday at 2:01 PM

Because this is how LinkedIn “specialists” promotes LLM. The same specialists shouting about crypto a few years ago, then specialists about nft and now about how coding, architecture, accounting, law, medicine and basically every white collar job is solved and you just need enough money to pay for Opus/GPT.

master-lincolnyesterday at 10:15 AM

Yeah it has been looked at e.g. in [0]. They separate that from lying, but I think for the LLM context it should be included. To me the difference is humans do not bullshit at the same rate and I can find out over time who tends to bullshit more and exclude that persons info from my pool.

> Why is everyone expecting LLMs to be like the Star Trek computer?

Because they are often marketed as magic AIs, not as mere language models.

[0] https://bpspsychub.onlinelibrary.wiley.com/doi/10.1111/bjso....

glouwbugyesterday at 2:38 PM

It’s not a lie if everyone collectively believes it

bravetraveleryesterday at 9:59 AM

Marketing, essentially

oshrimptonyesterday at 9:09 AM

I would be so curious to find a comprehensive benchmark on this, humans do have an unfortunate ahem Dunning-Kruger effect ahem tendency to do this