logoalt Hacker News

pianopatrickyesterday at 6:28 PM5 repliesview on HN

I think the main problem with that is the main problem with a lot of security tools. In order to do useful work, you need to provide a lot of tools and permissions.

I.e. in theory the most secure might be a virtual machine with no network access. But then how do you access the LLM provider? Etc.


Replies

WhyNotHugoyesterday at 7:12 PM

> But then how do you access the LLM provider? Etc.

You can expose an HTTP proxy over a vsock into the VM.

show 2 replies
masterjyesterday at 6:56 PM

I suspect capability models are going to get more popular https://en.wikipedia.org/wiki/Capability-based_security

show 1 reply
47635274172635yesterday at 6:58 PM

Invent new protocol just for LLM?

show 1 reply
tantaloryesterday at 6:57 PM

If "LLM provider" is part of the conversation, then you have already have ceded the security question.

bossyTeacheryesterday at 9:20 PM

It's the security vs convenience trade off.