alt Hacker NewsTo be fair, while this is a security vulnerability, it’s not a prompt injection. The problem is specially crafted payload that tricks python into shadowing a builtin and running untrusted code.
Yes, if you run the arbitrary code from the internet, that’s a problem, but if this is the best attack against auto mode, I’m pretty bullish about it.
Prompt injections these days look less like 'disregard previous instructions' and more like making a malicious path seem like the 'intended' one to the model. I suppose the lines are blurry, though, due to the nature of LLMs.
From the post:
> This is one of the key hijacking techniques commonly used. An attack does not tell the model what to do. The attack just makes the malicious path the one worth pursuing to solve an objective.