alt Hacker NewsInformation density of the interpretability of the intent from the perspective of a human (or human-like).
If the intent is not easy to understand, it's information sparse. Because it takes a lot of CPU (or brainpower) to interpret.
You can run gzip on an English sentence to make it more textually dense, but clearly it is not more information dense in this context.
I’d buy a ticket to ride the philosophical “human-like” comment with you, but I think you might have made an incorrect assumption. The model did not take longer to “decompress” the prompt than it would take for any other prompt of equal token length. If you run it with thinking enabled you might be mistaking that output as some kind of necessary gunzip step, but it’s not. Disable thinking and try again.
The prompt was also “easier to understand”, purely in the sense that the response is more or less guarantee to be what I wanted it to say, which was the point behind the demonstration. I went into more detail on it in another comment around here.