logoalt Hacker News

kylehotchkisstoday at 4:51 PM0 repliesview on HN

When you don't limit on-device AI to "can be used to run coding model", Mac minis are great. My M4/16gb been working on a long term research project using Qwen 2.5 8b for months now. The performance is good enough for processing a lot of small text prompts.