alt Hacker NewsIt’s making ddr3 relevant again as well. Bought 256GB DDR3 ECC for ~200 usd a couple weeks ago for my ai server (wip).
These old workstation platforms seem to be perfectly fine for hosting GPUs for local llms.
It’s making ddr3 relevant again as well. Bought 256GB DDR3 ECC for ~200 usd a couple weeks ago for my ai server (wip).
These old workstation platforms seem to be perfectly fine for hosting GPUs for local llms.
256GB means you are going to be using system RAM instead of completely offloading to GPU, I assume? If so, you should make sure your CPU has AVX2.