alt Hacker NewsThey are specified in the token map as special tokens. Presumably they get trained to use them when they get RL'ed to use tools?
They are specified in the token map as special tokens. Presumably they get trained to use them when they get RL'ed to use tools?
I imagine it would have to be something like that, except that I would have expected the "embedding" of the tokens to be final by that point. They would not have ever seen the tokens before, since they definitionally don't appear in any of the prose written on the Internet…?