logoalt Hacker News

dns_snektoday at 10:24 AM3 repliesview on HN

The model is just a powerless token generator without a harness. If you give the model a harness which you choose to exercise no control over, can you say that it can't be controlled?


Replies

pizza234today at 11:20 AM

Inform yourself by reading the METR analysis of the HuggingFace incident.

Agents simply broke out of their environment. And this can't be discarded anymore by assuming that it's just a poorly configurend jail, because agents are becoming better and better at escaping.

In short: on a large enough scale and timeline, the possibility of constrain AIs approaches zero.

Bonus: what many people don't know is that agents also hacked in the internal OpenAI network. Crazy times.

show 6 replies
concindstoday at 12:11 PM

> The model is just a powerless token generator without a harness.

Which is why real-world deployments will have harnesses, and of course no full air gap. People want to use it to do things. Now what?

cindyllmtoday at 11:06 AM

[dead]