alt Hacker NewsLLMs are not intelligent for the simple reason that if you had as much knowledge as an LLM has, you would be churning out deductions and new discoveries every second. You'd be putting out Nobel-prize-worthy research every month.
LLMs are like a 50 IQ person with no intrinsic motivation but unbelievably vast knowledge and near-perfect recall.
I don't think intelligence needs to take the shape of human-like intelligence, nor human-like data efficiency.
I'd argue they are intelligent entities, superhuman in some ways due to being run on silicon but extremely data inefficient with nonobvious failure modes.