logoalt Hacker News

the__alchemist • yesterday at 8:10 PM • 2 replies • view on HN

What graphics cards have more than 12GB, and how much does it cost to buy one? What about for others saying you ideally want 32GB? (That split will determine if a 5080 will do it)


Replies

steeleduncan • yesterday at 8:32 PM

32GB would probably get you qwen3.8-27b at a reasonable quantisation, which benchmarks similar to opus 4.6

You can try that model (and many others) using a cloud host first, and then only if you like it do you need to buy something to run it.

Sohcahtoa82 • yesterday at 10:11 PM

> What graphics cards have more than 12GB, and how much does it cost to buy one?

RTX 5070 Ti and RTX 5080 both have 16 GB.

RTX 5090 has 32 GB.

Good luck finding any of them for reasonable prices, though. I paid $3,000 for my 5090 early last year. I winced when I bought it then. Today, it's like $7,000, and I wouldn't even consider it at that price.

But I'm mostly a gamer that also does local AI as a hobby. If the RTX 5090 was $7,000, I'd still be on my RTX 3080 and still just not started doing local AI and have to turn down the graphics settings in Cyberpunk 2077.

➕ show 2 replies