alt Hacker NewsGreat, private AI, at the cost of >1000x the resource usage. Because apparently AI companies weren't already using quite enough energy to cook the planet.
The most private AI is the one running on my own hardware, not in some giant data center.
Replies
Eueudhsbsj32 • yesterday at 7:48 PM
Aren't there already much more efficient ways to make inference private?
Using regular encryption and secure enclaves, there are already providers that are roughly 2x the cost of normal providers. For example, https://tinfoil.sh/
➕ show 5 replies
> The most private AI is the one running on my own hardware, not in some giant data center.
I want that too, but you gotta ask yourself the question how efficient that is compared to running it in a datacenter shared with everybody else.