alt Hacker NewsI'd like to think so but the existence of Google and Apple and Microsoft's cloud based photo tools with phone integration suggests that's false.
You could run a pretty good home server on $50 of gear and yet we never saw any real adoption of OwnCloud/NextCloud style products as an alternative to Google Drive/Photos or Apple Cloud.
Why should LLM/Transformers be any different? Especially when you need a proper expensive GPU to run them instead of a Raspberry Pi?
Replies
com2kid • today at 5:44 PM
After the latest round of cloud storage price increases my non technical wife has been asking if we can do local backups instead...
Apple's photo tools run on device, and they'll probably ship more on device foundation models at WWDC too.
On-device AI is going to be important, I think. It doesn't have to take the form of a chatbot UI to be useful.