alt Hacker News> there is usually carrier boards
You can order the SXM carrier boards on eBay/Alibaba today.
> You wouldn’t repurpose these for home gaming, it would still be for llms
When small businesses, home-labbers and prosumers have cheap access to potent GPUs, there will be a Cambrian explosion of grassroots creativity and innovation in areas that are "beneath" AI labs expansive ambitions; I want to see the OBS-equivalent of LLMs. Hell, I'd love to see what some broke artist can do with OBS, an H100, and an open video model.
Good luck powering a 400kw rack in your basement, if you are looking to do frontier model type stuff. Just a single machine can run in the 150kw range these days for the less exotic stuff.
It can certainly be parted out with proper motivation but it’s going to take a whole new ecosystem to support these in your typical home lab. Even then 20-30kw slices are electric car level energy consumers.