It's what makes people attribute intelligence to them, and why the manager types like them so much, and why I dislike them so much. And this article made me think it might just be inherent to how they work though, because they are LLMs and are doing token prediction.