logoalt Hacker News

NitpickLawyertoday at 6:55 AM1 replyview on HN

On openrouter 2.5 is at 0.60/3$ per Mtok. That's haiku pricing.


Replies

storystarlingtoday at 8:41 AM

The unit economics seem tough at that price for a 1T parameter model. Even with MoE sparsity you are still VRAM bound just keeping the weights resident, which is a much higher baseline cost than serving a smaller model like Haiku.