alt Hacker NewsLLMs most definitely are limited. What’s your position, that LLMs have no limits? That’s obviously wrong, and the fact you hold such an unreasonable position may be why you react so strongly to pieces like this one.
LLMs most definitely are limited. What’s your position, that LLMs have no limits? That’s obviously wrong, and the fact you hold such an unreasonable position may be why you react so strongly to pieces like this one.
What's the obvious limitation?
To Yann LeCun it was "obvious" that you can't build a world model from a text, so he predicted that even "GPT 5000" can't predict that an object sitting on the table would move together with the table. But GPT-4 could solve this task and provided correct explanation. GPT-5 can solve much more complex tasks, code physics simulation, etc.
Now people talk about invention of General Relativity as something LLMs can't do... something almost no human was able to do either.