alt Hacker NewsI can definitely see a world where you run stuff local first, for all the reasons we know. Sometimes, you are going to want more powerful models, faster, you’re travelling, etc. You might only use these 5 to 10% of the time, but I’m guessing that’s the market they want.
But one can already switch models in a harness between llm providers. I doubt such a pivot can get some much traction.