alt Hacker NewsThere is a finite number of rces that LLMs can find. We‘re in for a rough couple of years but on the other side of the transition we‘ll have more secure software stacks. I’d rather that everyone got the full capabilities and we’d weed out the bugs quickly than restricting LLMs for all but three letter agencies.
Replies
> There is a finite number of rces that LLMs can find.
This is a factor in favor of stability/security of software, but there are many others against:
- software (code) changes all the time, so there are windows of opportunity during which a bug is exploitable; in addition to that, a bug may take a relatively long time to be fixed
- a model used for attack may be stronger than the model used for defense, both in terms of model quality and compute allocated
- with software complexity increasing (and team/companies behind projects getting bigger), the margin for mistakes grows thinner, and introducing misconfigurations or weaknesses becomes exponentially easier (with "exponentially", I mean literally, because the interdependence of the components, both technical and human)
And last but not least: in general, attackers are more skilled than defenders; in best case, defenders are well-trained. And the idea of having the population of potential skilled attackers growing is very unsettling.
This assumes we don't create other bugs/vulnerabilities while fixing the existing ones.
only if unreviewed LLM code - as is becoming increasingly the standard - isn't introducing new RCEs constantly
No one with a shred of intellectual integrity uses a "There is a finite number" strawman.
As a matter of basic logic, there will never be a time when it will be known that there are no bugs.
We’ll have the same level of security as before; it’s just that, without LLM help, hackers won’t be as effective as before. So the bar is raised.
What makes you think RCEs are being found & fixed at a rate that’s faster than they’re being introduced?
I could see it going either way.