The only consumer GPU with 32GB of RAM in the current generation is the RTX 5090. NVidia claims it hasn't been discontinued but it's also impossible to buy and the resale prices have spiked to $5k+. So for a PC with 256GB of RAM and a 32GB GPU you're over $10k just for those two parts. Many believe, myself included, NVidia's new "flagship" will be announced in early 2026 and will be the RTX 5080 Super with 24GB of RAM, also probably costing $2k+ anyway.
What you probably want instead is a Mac Studio with an M5 Ultra. The 256GB model is ~$11k. The problem? Demand is so high that the lead time last I checked was March. But this will give you 256GB of shared memory, well above the 32GB you'll get on a 5090.
If you can live with 96GB (or less) on a Mac Studio it's quite a lot cheaper and the lead times are far quicker.
> The only consumer GPU with 32GB of RAM in the current generation is the RTX 5090.
Well not really, there is the AMD Radeon AI PRO 9700, which is a RX 9070 (or possibly the XT, dunno) with 32GB VRAM. It does use slower GDDR6, but it has "held its price better" (for some definition of better) and is still available for like 2.3k€ (this includes taxes). Though I remember when I was thinking of buying one when it was 1.4k not too long ago and didn't :( now I just don't bother looking anymore.
For model training w/cuda libraries??
The AMD AI Pro R9700 and Intel B70 are current-gen, 32GB consumer GPUs. I've run both, and can confirm that while single cards don't perform as well as an Nvidia 5090, their price-to-performance ratio is competitive. If you can get multiple (and totally can if a 5090 is within budget), you can run bigger models far more easily. ROCm and SYCL aren't as mature as CUDA, but have finally gotten to the point where they can do what needs to be done without too much fuss. I don't regret getting 8x R9700, and can run just about any model I want.
A Mac studio won't be able to keep up with my rig.