logoalt Hacker News

Eueudhsbsj32yesterday at 7:48 PM5 repliesview on HN

Aren't there already much more efficient ways to make inference private?

Using regular encryption and secure enclaves, there are already providers that are roughly 2x the cost of normal providers. For example, https://tinfoil.sh/


Replies

catlifeonmarstoday at 4:00 AM

> aren’t there more efficient ways

Heh yes absolutely, but there is some nuance.

Secure Enclave still requires you to trust the operator and also trust that it’s configured properly, supply chain is secure, etc.

The beauty of FHE is that it doesn’t rely on the compute being secure. All you need to secure are things you already have control over as a client.

I agree with you it’s still way too slow to be generally useful. (By general, I mean practical for arbitrary computation — you can relax the requirement and have fast homomorphic encryption if you only do specific kinds of operations).

rahkiintoday at 6:45 AM

Yes, by running models locally

siddthesquidyesterday at 8:19 PM

If I used regular encryption to send my credit card information to an AI with fraud detection, the provider still needs to decrypt that data on their side at some point before it goes into the AI.

Using this other encryption, the provider has neither need nor capability to decrypt it on their end, so the user gets extra security.

show 1 reply
whyagetoday at 2:08 AM

Check out opaque.co

delusionalyesterday at 9:36 PM

There's a much more simple and much more efficient way to do it: Policy and Legal contract.

show 1 reply