alt Hacker NewsI really don’t understand why the LLM web chat clients have all converged on this UI where one character appears at a time. It is kind of fun the first time (like you are watching some Harry Potter special effects where an enchanted book writes itself). But really they could send sentence or paragraph long chunks of text, it would be fine.
Seems like an artifact of the time when tokens-per-second were low enough that people needed to be informed that the machine was actually doing something.
> But really they could send sentence or paragraph long chunks of text, it would be fine.
The problem is that the content is multimodal, often recursively.
You can be inside markdown and then have a python code section. Simply detecting these boundaries is already challenging.