logoalt Hacker News

ianm218yesterday at 10:57 PM2 repliesview on HN

This is hard to say definitively. The new Nvidia Vera Rubin chips are 35-50x more efficient on a FLOPS/ megawatt basis. TPU/ ASICS/ AMD chips are making similar less dramatic strides.

So a service ran at a loss now could be high margin on new chips in a year. We also don’t really know that they are losing money on the 200/ month subscriptions just that they are compute constrained.

If prices increase might be because of a supply crunch than due to unit economics.


Replies

NewJazztoday at 3:33 AM

What is your source on 35x more efficient? That seems like a wild performance improvement that I would have hears about.

My research shows claims of 10x efficiency, but that number is very questionable.

show 1 reply
scuff3dtoday at 1:42 AM

Given the massive costs on training, R&D, and infrastructure build out in addition to the fact that both Anthropic and OpenAI are burning money as quickly as they can raise it, the safe bet is on costs going up.