alt Hacker News> Realistically, serving 300 users per GPU you'll spend a lifetime cost of about $133 per user, plus the datacenter/upkeep bill.
What is the operational cost and when does it become more expensive than the upfront capex?
The B200 tops out at 1000W and idles around 140W. It averages around 600W. https://www.lightly.ai/blog/nvidia-b200-vs-h100 U.S. average electricity cost is $.14 per kWh in March. https://www.eia.gov/electricity/monthly/epm_table_grapher.ph...
600/1000 *.14 =$0.084 per hour. $2.01 per day. $60.30 per month. With 300 users, $.20 per user per month. Seems fairly cheap for the electricity.
Does anyone know how to estimate colo/data center rent costs? Where did I screw up my estimates?
Replies
I wonder what the power costs are when you put jet turbines in front of your DC to power it.
The EIA says $.14 for "Commercial" but $.086 for "Industrial". I assume that the big data centers have such high electricity costs that they would be able to cut better deals that would put them in line with the lower "Industrial" rates. So, even better potential margin.