It selects tokens but they expand to embedding vectors which are huge, also in memory and attention requirements, I think?