If you can be persuaded, looking into how modern LLMs are trained with reinforcement learning may change your views.
https://arxiv.org/abs/2510.07364 event rl isn't necessary for LLMs to develop reasoning capabilities in some cases
https://arxiv.org/abs/2510.07364 event rl isn't necessary for LLMs to develop reasoning capabilities in some cases