alt Hacker NewsAnthropic has said inference is profitable. That’s a biased source, but the math pencils.
This is why switching to local open weight models saves a lot of money. (Even though it’s not apples to apples.)
Anthropic has said inference is profitable. That’s a biased source, but the math pencils.
This is why switching to local open weight models saves a lot of money. (Even though it’s not apples to apples.)
Anthropic also recently tweaked their usage limits to discourage use during peak hours. Why would they do that if inference was profitable?