alt Hacker NewsA savant who confabulates about 10 % of the time, per the best benchmarks, no matter how much “thinking” it does (GPT-based LLMs will always “hallucinate”)? How do you trust it?
I would rather take the time to ask the same question to the Emacs contributors mailing-list, who have the incentive to check their posts for mistakes.
Replies
brabel • today at 7:29 AM
How do you trust a human? Are humans infallible, or at least better than AI at explaining things? I known my answer.
➕ show 1 reply
Have you ever worked with a modern agent? They let many weak assumptions slip because their cognitive functions aren't remotely as deep as human's (that's what makes their code a horror), but they have also been trained to hyperfocus on verifying and grounding everything they do and say, you have to actively stop them from doing so when it's unnecessary. This not what I can call confabulation in any good faith, let alone 10% of the time. I think you've been misled by the old paper you cite below, it doesn't say what you likely think it says.