logoalt Hacker News

reactordevyesterday at 8:44 PM4 repliesview on HN

Not to mention the text-only 0.8GB version. Just crazy. You can have basic real-time conversations on-device that's video and audio aware now.


Replies

yaloktoday at 4:00 AM

0.8GB is for text only. It's more like ~1.1GB if you include video/audio encoder

show 1 reply
simonwyesterday at 9:38 PM

Have you seen a 0.8GB model file floating around yet? I couldn't find one earlier.

show 1 reply
viccistoday at 6:11 AM

I'll be honest with you. My main ask for on device AI is that when I am typing "Going out for a quick j" it corrects to "jog" and not "Jonathan". I don't think it needs that many gigabytes.

show 1 reply
madducitoday at 5:57 AM

Where is it? On ollama I see only the bigger one

show 1 reply