logoalt Hacker News

jorvi • today at 3:39 AM • 1 reply • view on HN

You don't.

Once you factor in cost of electricity and depreciation of hardware, it is more expensive to run locally.

There are many arguments for running local but cost isn't one of them.

Replies

nodesocket • today at 3:50 AM

> but cost isn't one of them.

Let's do quick back of the napkin math.

  - Mac Studio M5 Ultra, 80-core GPU, 256GB memory, 2TB storage -- $11,299.00.
  - Power (385w continually 100% of month) is $40/mo (my regional) or $480 annually. Let's say power is 3x more expensive in California, which it probably is, that's still only $1,440 annually in power.
The Studio M5 Ultra has a worklife of at least 3 years.
➕ show 1 reply