alt Hacker NewsNo one on the planet could run a frontier model. The amount of VRAM you need would bankrupt a normal person.
I suspect most people don't have enough storage space to even download a frontier model.
Replies
freecodeio • last Wednesday at 10:53 PM
all the enterprise clients which the two frontier companies rely on have the money to buy the hardware and run a frontier model themselves, it just becomes a nobrainer to buy your own hardware if you have 10-20b token output per week
➕ show 1 reply
This comment makes no sense. The original comment wasn't specifically to do with the average person hosting at home.
There are already: - hundreds of western providers hosting open models, including large ones such as Kimi K3 which is near Opus/Sol sizes.
- people hosting large models such as Kimi K3 at home. Check on reddit, there are people with 20x DGX Spark setups etc.