logoalt Hacker News

biomcgaryyesterday at 5:20 PM1 replyview on HN

Do you know if any of these multi-stage approaches can run on an 8gb M1 Air?


Replies

armcatyesterday at 7:40 PM

They should! If you take Parakeet (ASR), add Qwen 3.5 0.8B (LLM) and Kokoro 82M (TTS), that's about 1.2G + 1.6G + 164M so ~3.5GB (with overhead) on FP16. If you use INT8 or 4-bit versions then are getting down to 1.5-2GB RAM.

And you can always for example swap out the LLM for GPT-5 or Claude.