What's the obvious limitation?

To Yann LeCun it was "obvious" that you can't build a world model from a text, so he predicted that even "GPT 5000" can't predict that an object sitting on the table would move together with the table. But GPT-4 could solve this task and provided correct explanation. GPT-5 can solve much more complex tasks, code physics simulation, etc.

Now people talk about invention of General Relativity as something LLMs can't do... something almost no human was able to do either.