alt Hacker News> LLM may be a great technology, but it's probably not a good model for how humans learn and use language.
but from all models, it's the closest, "all models are wrong, but some are useful"
Replies
LLMs behave like they're closest, but only during execution. During training, obviously, they don't resemble the human brain at all. No human reads a million books before they begin to speak.
And I'd be hard pressed to identify many cognitive characteristics of LLMs during execution that resemble human thinking, aside from those that are readily parrotable.
As a model of human cognition, LLMs deep suck.
What reason to we have to believe that LLMs are the closest model we have for how humans learn language.
We considered the hypothesis that humans are a general intelligence that figures language out by exposure. The evidence has consistently come back that that is not how humans actually work. A model where humans are hardwired with a lot of knowledge about language, then fill in the gaps based on exposure still appears to be far more accurate.
The only thing LLMs show is that it is possible to learn language de-novo.
> but from all models, it's the closest
Care to back this up? What evidence do we have to suggest that back propagation, self attention, and byte pair encoding are mechanistically similar to human cognition? Similarity of the outputs says nothing about similarity of the machinery underneath. Turboprop engines tell us nothing about how birds fly - doesn't matter that they successfully transport millions of people around the world.
I would say that when it comes to higher level cognition, logic engines are more human like even if they only have a tiny fraction of the practical utility of LLMs.