Although I agree with you, in fairness, there are some lively controversies in the world of cognitive science and philosophy of mind about whether this meaningfully differs from human thinking at sufficient scale.

The general idea is that the building blocks of "coherent models" and "processes" within the churning of the human intellect are also, in so many words, prior art and existing concepts, and so, while the human mind is not a text model, a sufficiently large and sensorily multimodal neural net would not be too different. Neural nets are, after all, inspired by what we understand of human cognition -- they'd say.