logoalt Hacker News

kansmtoday at 12:21 PM3 repliesview on HN

Wait, so I can download it and run it locally now?? Wow... But it probably won't work on my computer, right?


Replies

loudmaxtoday at 12:55 PM

The short answer is no, it won't work on your home computer. In it's current form it needs something like 594 GB of memory, far outside what you can reasonably run on normal consumer hardware in 2026.

If you have really high end hardware, you might be able to squeeze a heavily quantized version of Kimi-K3 onto your rig, but it will be too slow or too lobotomized to be useful.

This does put a near state-of-the-art open weights model within reach of what a small or medium business could afford if there's a case for local inference. It's probably not as good as Claude Fable or ChatGPT Sol. But if you're an organization that has a genuine need to run inference locally, this is a real possibility.

Is this for your homelab? Not in any practical sense.

Is this a possibility for organizations that can justify $1M or so on hardware for a near SOTA model they have full control over? Yeah, absolutely.

show 2 replies
0x1ceb00datoday at 1:30 PM

Yes it will. Buy a 4TB nvme, allocate 3TB as swap, and run a gpu emulator on your cpu.

show 1 reply
k__today at 12:44 PM

Right