I'm heavily biased here. We are building a ChatGPT/Cowork like solution for data privacy concious enterprise customers.

This is already starting today, not in 2-3 years. Currently customers are using our solution with cloud-hosted LLMs, and for the meantime costs are acceptable, but we are also building capabilities to do organizational rollouts of local LLMs, so that the majority of tasks can be offloaded to the local machines of the employees (which are most of the time underutilized anyways). For a lot of typical office worker tasks, this works great. This also has the nice side-effect of allowing C-level to use AI locally for highly sensitive documents, without a risk of leakage.

I would expect that the cost-concious customers will push the broader market of harness providers to allow for solutions like this going forward. I am however not sure how much this will take hold on the consumer market.