In chats with models like deepseek the LLM makes many basic math wrong claims. Maybe more advanced models can in special circumstances, guided by the work of humans and Lean, prove theorems. But just like in RL, the brute force approach of failing a million times may not be enough when the reward is far.

In math the reward is finding the decomposition that reduces the problem to simpler cases, and in many cases that reward is very far. Furthermore, the LLM may process the many cases fast, but the decomposition often comes from a human, and the model takes the credit for the proof.

This foundation could provide the LLMs with the decompositions, generated by human ingenuity, that they need. But once supplied, the model can run the cases and get the credit. Hence more credits for LLMs and fewer jobs and worse prospects for humans, even if it isn't an intended consequence.