The worst thing about tokens is that they call it "millions of tokens."
It should be megatokens.
One kilotokens would have to be 1024 tokens, and so on, as we’ve congregated on multiples of that for context window sizes.
Why?
One kilotokens would have to be 1024 tokens, and so on, as we’ve congregated on multiples of that for context window sizes.