alt Hacker News> I understand that such models can be used by malicious actors, but it’s fair to have it publicly available
I feel like there should be some mechanism to prove you own the code/app/site/whatever and it will remove the guardrails from the LLMs allowing them to find and fix these vulnerabilities.
Replies
gdhkgdhkvff • today at 12:58 PM
Isn’t this essentially what anthropic is doing, albeit in a manual fashion? They work with code owners to run mythos and find issues.
➕ show 3 replies
leobuskin • today at 12:22 PM
Impossible with source code, possible to bypass with app/site
➕ show 1 reply
This is a "they have guns so we need guns" scenario.
You can't guarantee everyone else will use a neutered model.