logoalt Hacker News

brookst • yesterday at 3:24 PM • 1 reply • view on HN

Would byte tokens really solve how many r’s? It seems like it would require a level of introspective awareness of the tokens being processed that I don’t think transformers have. But I’m not expert enough to go beyond that intuition, so could easily be wrong.


Replies

Ohentis • yesterday at 8:52 PM

Models generally are capable of counting

➕ show 1 reply