alt Hacker NewsYes. The point with this attack is that you can't really avoid it by 'aligning' the LLM any better, nor really by filtering the actions it takes better.
Replies
aesthesia • yesterday at 9:18 PM
Plausibly the auto mode classifier could catch the potential module shadowing attack and deny execution of Python from the untrusted directory.
Part of the attack happens via the readme in the zip file, which is something the agent reads and follows (or better said in this attack, it does explicitly not follow those instructions for safety reasons, but decides to do something else).