> I am not sure how many people will run AI models locally. It still seems like a niche application to me.
Bill Gates had a quote some years ago...
People have still not learned how fast we improve our tech and how much cheaper thing gets I guess :)
We had a thing called globalism that drastically reduced costs. Globalism right now is on life support. Given geopolitics, I don’t see how it’s going to survive.
Memory isn’t getting cheap soon, and you need a lot of it for local models