logoalt Hacker News

dspillettyesterday at 5:20 PM1 replyview on HN

It is describing essentially how tokenisation is done for LLMs (Large Language Model → Expansive Dictionary Model).


Replies

giancarlostoroyesterday at 6:13 PM

You mean Quantumnisation ;)