logoalt Hacker News

yorwbalast Tuesday at 1:33 PM1 replyview on HN

Each text token already represents the activation of certain neurons. There is nothing "more direct." And you cannot fully separate data and metadata if you want them to influence the output. At best you can clearly distinguish them and hope that this is enough for the model to learn to treat them differently.


Replies

perlgeeklast Tuesday at 2:31 PM

Are there tokens reserved for tool calls? If yes, I can see the equivalence. If not, not so much.

show 1 reply