A human being who states X (implying they know it to be true) will behave in a way that is consistent with X being true.
An LLM will happily say X and behaves in contradiction to X. Because it does not reason. Its behavior is not derived from things that it claim (or appears) to know.
> A human being who states X (implying they know it to be true) will behave in a way that is consistent with X being true.
That is literally not true and why we talk about "stated vs revealed preference" and such.