Not all transformers are _language_ models - the sequences of tokens don't have to be sequences of words.
In this case, what are the tokens?
[flagged]
alt Hacker News
In this case, what are the tokens?