logoalt Hacker News

loandbeholdtoday at 3:32 AM1 replyview on HN

You need to separate training and inference usage of GPUs for this analysis.


Replies

Mathnerd314today at 5:11 AM

"Inference consumes 60–90% of total AI lifecycle costs." So shovel is not the right analogy, more like GPU = coal burning engine. And yes, coal was a big railroad expense, more so than financing construction debt.