logoalt Hacker News

jaggederestyesterday at 10:23 PM3 repliesview on HN

I think the biggest reason is to own the stack so your model can't be changed out from under you, but maybe I care about that too much.


Replies

Aurornisyesterday at 11:10 PM

> I think the biggest reason is to own the stack so your model can't be changed out from under you,

The concern would be future regulations that prohibit you from buying a hosted version of the model. Even that could be bypassed with a VPN to another country but it's more work to go through the payments.

As long as there is demand for a model, it will be hosted by multiple providers.

show 3 replies
zackifyyesterday at 11:07 PM

You do, there's like 20 providers for any model on openrouter. You can also just spin bedrock or gcp and download the weights for later if you're worried. It's never going to make cost sense when the token rate is so low with how expensive ram is

show 1 reply