I've done my own research on that as a part of my Aqueous [1] archiver, and the conclusion is that the inherent information entropy is about as same (CJK scripts, for example, compresses much better when they are turned into their native character encodings). So a script-aware tokenization should make that irrelevant.

[1] https://lifthrasiir.github.io/aqueous/ (specifically wrt-recons-hangul codec)

Are bytes relevant? These things are billed by the megatoken, not the megabyte.

utf8 is just one of the encodings that exist, and is kind of irrelevant at the point it contacts the llm

bit configurations aren't uniform across those bytes, everything should compress to similar sizes