alt Hacker News- If an AI provider has control over the AI algorithm running in the secure enclave, they can easily have functions that provide them the plaintext through a separate channel. secure enclave does not prevent that
- The output can reveal information to the provider, which homomorphic encryption would have protected
- Inference is running on GPUs - so its moreso nvidia than amd/intel, but this is just a nit
So homomorphic encryption exists so the user doesn't need to do work to figure out if the provider could be adversarial.
Replies
yes I agree. although just to nitpick, there are ways to prevent side channel attacks within the enclave using software tricks. and output can remain in ciphertext via diffie hellman with client, etc. etc. but you're right that FHE provides a much more concrete guanrantee.
> they can easily have functions that provide them the plaintext through a separate channel
That's why they provide cryptographic attestation that the open model they're running is exactly what they advertise without any modifications.
That combined with GPU confidential compute should protect your LLM prompt and output.