logoalt Hacker News

dawg91yesterday at 9:03 PM1 replyview on HN

They do verifiable inference on TEEs for the open source models. The anthropic ones I think they basically proxy for you (also via trusted TEE) so that it cant be tied to you. VPN for LLM inference so to speak.


Replies

ramozyesterday at 9:26 PM

Can you link to the verifiable inference method?

show 1 reply