There's so many different models, from hosted to local and there's almost no switching cost as most of them are even api compatible or supported by one of the gateways (Bifrost, LiteLLM,...).

There's many things to worry about but which LLM provider you choose doesn't really lock you in right now.