alt Hacker News> edge AI deployment
Isn't the "edge" meant to be computing near the user, but not on their devices?
Replies
Your device is the ultimate edge. The next frontier would be running models on your wetware.
It depends, because edge is a meaningless term and people choose what they want for it. In 2022, we set up a call with a vendor for ‘edge’ AI. Their edge meant something like 5kW, and our edge was a single raspberry pi in the best case.
For sure. 1000%. Anyone disagreeing with this has lost their marbles.
For those that have lost their marbles: sure, people use words incorrectly, but that does mean we all have to use those words incorrectly.
In compute vernacular, "edge" means it's distributed in a way that the compute is close to the user (the "user" here is the device, not a person); "on device" means the compute is on the device. They do not mean the same thing.
No it does not. This is about as “edge” as AI gets.
In a general sense, edge just means moving the computation to the user, rather than in a central cloud (although the two aren’t mutually exclusive, eg Cloudflare Workers)