logoalt Hacker News

friendzisyesterday at 7:10 AM2 repliesview on HN

"if only we could align the models just a tiny lil bit better" is a rehashed "if only we could escape untrusted inputs just a tiny lil bit better" from 2000s, that were RIPE with various form of malicious injection.

Every command+data channel in existence has been and will continue to be exploited one way or another, because the solution space is for all intents and purposes unbounded. Sure, highly defensive escaping reduces attack surface dramatically, but e.g. prepared statements eliminate the whole class of bugs.

As far as I understand, current LLMs are architecturally incapable of this separation. Given the inherently recursive nature of GenAI, the model itself is part of the input space, making validation essentially impossible.


Replies

insanitybityesterday at 12:15 PM

Escaping inputs is at least somewhat tractable. It's unclear if alignment is.

show 3 replies
agosyesterday at 2:45 PM

it's the "just one more lane bro I swear" of AI