it feels like this is a bit similar to the famous dropbox comment.
I guess maybe another anecdotal comment, but I'm an engineer myself, have a home server for simple stuff, and I pay $200 a month to chatGPT for a pretty simple usage and really don't see myself go and run my own open source model, especially at the speed at which they evolve and change.
99% of the world will not setup their own open source model, just like 99% of the world is not setting up their own servier with ssh copy whatever the dropbox comment was saying.
If you were paying API prices (for ZDR), I suspect you would be eyeing local hosting. But if you’re comfortable selling your data, then the subscription prices are going to be hard to beat, for however long they may last.
99% of the world is also not spending $200/month for chatGPT. They're using whatever free shit they can get to ask basic questions.
You don't have to rub it yourself though. There's lots of pure inference providers which are way cheaper than the big guys and have cheaper models