logoalt Hacker News

sleight42 • yesterday at 10:14 PM • 0 replies • view on HN

Right. Except not.

There are plenty of self-hostable models. Hell, there are now model-specific runtimes that make it easy to run big models on consumer hardware. Strata, just a couple days ago released, lets me run Qwen 3.8 Flash Next at home on a single 3090 at 90 tok/s.

So, yeah, I'll be passing on these "labs" walled gardens,