> 5 kW to work with per cabinet
have my expectations been shot by reading too much about Nvidia's latest and greatest, or does this seem quite low?
That’s standard practice in many data centers; but you can often pay more to get more amps delivered to your rack.
No, your expectations are not wrong. I'm a small business. A fully stacked AI/GPU cabinet is multiples of this. A single GH200 based server will have 2x2.7 kW power supplies in a 1U form factor. As you can imagine, I am not running a cabinet full of such servers. But you don't need AI power requirements to do normal software. And there's lots of normal software to do!