logoalt Hacker News

zozbot234today at 5:51 AM1 replyview on HN

The raw margins on proprietary model inference are rumored to be quite high though (they have to successfully defray the entire investment into model training and datacenter capacity for inference, which is massive enough). The API cost you're paying for the model includes that raw margin.


Replies

alightsoultoday at 2:03 PM

The Chinese have similarly high profit margins on Inference via their first party api