logoalt Hacker News

dannywyesterday at 1:29 PM3 repliesview on HN

You can partially tell by the tokeniser; which gives you some hint into the training corpus mix.

</div> is four Gemma4 tokens, but one Qwen3.6 token.


Replies

stymaaryesterday at 7:56 PM

Looks like we have a /r/localllama dweller here.

venusenvy47yesterday at 1:55 PM

Where do you find this information for each model?

show 2 replies