logoalt Hacker News

docjayyesterday at 8:00 PM3 repliesview on HN

Lexical-priming->semantic-space-constraint;specialized-lexis+=sharp distributional-signature;∴ tight concept-cluster; generic-lexis->diffuse-activation, broad candidate-set;Attention-heads key/query-match domain-tokens;"Hamiltonian"->{operator,eigenstate,quantum,energy}->register+domain locked;Net:constrained-decoding,vocab=soft-prior over output-distribution; register-matching;#taskdef=decompress->continue


Replies

adam_arthuryesterday at 8:37 PM

Information density of the interpretability of the intent from the perspective of a human (or human-like).

If the intent is not easy to understand, it's information sparse. Because it takes a lot of CPU (or brainpower) to interpret.

You can run gzip on an English sentence to make it more textually dense, but clearly it is not more information dense in this context.

fliryesterday at 9:13 PM

Chatbot expanded this into something that made sense, but I've no idea if it's what you meant. There's an irony there somewhere.

mhjklyesterday at 10:00 PM

How do you make these compressed prompts like that