I had a similar thought to you, and found your question and the resulting discussion helpful!

Not at all. Getting really pedantic, tokenization is also a form of encoding, so it doesn't matter the modality you're using, you'll end up doing some type of encoding in some way.