alt Hacker News> Support for double-wide GPUs (Up to 450W)
I wonder how the driver situation is. From Jeff Geerling's work on running "big" GPUs on Raspberry Pis, my impression is that often less-common platforms should work but are littered with papercuts in practice.
Replies
AMD GPUs have worked on RISC-V for a couple years at this point. I have a Milk-V Titan that's paired with an AMD GPU running well: https://milkv.io/titan
Somehow the RISC-V designs mostly seem to have more coherent PCIe implementations, meaning some devices are easier to get running without the arm64 quirks drivers have to work around.
Drivers still need tweaking, most of the time, since most are still built assuming an amd64 world.
> Support for double-wide GPUs (Up to 450W)
oh a double wide surprise for the AI industry? just what we needed.
…and when it comes to the most common use of big-iron GPUs right now, neural network engines, they're all so poorly put together that a papercut is often fatal. If every dependency isn't the exact needed version, the whole thing will collapse, and using all but the most common hardware is sure to be unsupported in some deprecated library version that is absolutely required to get everything running.
I had thought Xilinx ISE and Altera Quartus had the market cornered on the most difficult environments to get running, but then LLMs and stable diffusion came along.