That’s not what’s happening.
The question is revealing that the model has a model of language but not of reality. It knows what words go together, but not real-world concepts.
This. LLMs are marketed on the false premise of all knowledge, intelligence and wisdom being possible to be encoded in language only.
This. LLMs are marketed on the false premise of all knowledge, intelligence and wisdom being possible to be encoded in language only.