logoalt Hacker News

kristjanssonyesterday at 8:02 PM2 repliesview on HN

> 5 kW to work with per cabinet

have my expectations been shot by reading too much about Nvidia's latest and greatest, or does this seem quite low?


Replies

arjieyesterday at 8:17 PM

No, your expectations are not wrong. I'm a small business. A fully stacked AI/GPU cabinet is multiples of this. A single GH200 based server will have 2x2.7 kW power supplies in a 1U form factor. As you can imagine, I am not running a cabinet full of such servers. But you don't need AI power requirements to do normal software. And there's lots of normal software to do!

shrubbleyesterday at 8:16 PM

That’s standard practice in many data centers; but you can often pay more to get more amps delivered to your rack.