logoalt Hacker News

masafej536today at 6:06 AM2 repliesview on HN

Point taken but there isnt any western providers there yet. Power is cheaper in china.


Replies

3ulertoday at 6:17 AM

These models are open and there are tons of western providers offering it at comparable rates.

NitpickLawyertoday at 6:12 AM

As this is a new arch with tons of optimisations, it'll take some time for inference engines to support it properly, and we'll see more 3rd party providers offer it. Once that settles we'll have a median price for an optimised 1.6T model, and can "guesstimate" from there what the big labs can reasonably serve for the same price. But yeah, it's been said for a while that big labs are ok on API costs. The only unknown is if subscriptions were profitable or not. They've all been reducing the limits lately it seems.

show 1 reply