One line of evolution seems to be toward some form of latent-space reasoning, as in [1]. Natural language seems like a relatively low-bandwidth channel for intermediate reasoning.
[1] https://github.com/sapientinc/HRM-Text
What does ‘latent’ mean in this context?
What does ‘latent’ mean in this context?