I don't think LLMs currently have direct reasoning abilities, but as we make them more complicated (MoE, RL) I think we're getting better at learning an implicit world model that guides the token output distribution towards making good hypotheses.