logoalt Hacker News

JonChesterfield • yesterday at 4:42 PM • 1 reply • view on HN

It's written down in the tokenizer. 256 of the tens or hundreds of thousands of tokens correspond to each byte, done.


Replies