alt Hacker NewsWe need a name for these pure hallucinations, something like lucies or looseys
Usually the hallucinations have some logic to them like a person with a similar spelling in some of the training sets. LLMs are mysterious!
We need a name for these pure hallucinations, something like lucies or looseys
Usually the hallucinations have some logic to them like a person with a similar spelling in some of the training sets. LLMs are mysterious!
GP didn't give enough information to know if this was actually a hallucination or not, let alone what type of hallucination. I.e. it's only a hallucination if no rugby player or surgeon is a John Doe, not if John Doe the GP isn't those things.
I wonder how much of hallucinating/"mistakes" in LLMs is because the training data is full of us filling in additional info we humans commonly feel or interpret as implied rather than something which manifests from the architecture of the LLM itself. I assume only a small percentage, but also a non-zero one.