logoalt Hacker News

simonwyesterday at 9:38 PM1 replyview on HN

Have you seen a 0.8GB model file floating around yet? I couldn't find one earlier.


Replies

reactordevyesterday at 11:06 PM

I think this is the one but it’s 0.8GB VRAM not 0.8GB size.

https://huggingface.co/google/gemma-4-E2B-it-qat-mobile-ct

But they could be cooking up a smaller one because the model card lists the Q_4 quants as being bigger than the mobile or text-only so I think we’ll need to wait for the Q_2_Distilled_Mobile_Textformer version. Still, just amazing work.