alt Hacker NewsThis comment makes no sense. The original comment wasn't specifically to do with the average person hosting at home.
There are already: - hundreds of western providers hosting open models, including large ones such as Kimi K3 which is near Opus/Sol sizes.
- people hosting large models such as Kimi K3 at home. Check on reddit, there are people with 20x DGX Spark setups etc.
I was being dramatic, but no normal person is running 20x DGX spark. That is 100K of slow VRAM. Not sure it makes a lot of sense TBH.