alt Hacker News> Literally nothing in this post comes across as bragging. A PR fluff piece would not call Claude "unsophisticated”. PR fluff pieces do not admit to legal wrongdoing.
I disagree. You’re just not the right audience to see it. But I think it’s totally fine that we have a different opinion here and I don’t want to convince you that I am right, and you’re wrong, because you are not wrong, you simply have a different perspective.
> You want them... to put themselves in jail? I doubt you'd hold yourself to the same standard if you made a mistake.
Yes, that’s what I expect from you if you play at that level, because that is the standard of responsibility you need to handle this kind of power.
And yes, I pretty much hold myself to the same standard because I have a zero CIVCAS track record from my time in the military and I had power over life and death every single day.
With great power comes great responsibility is not just a Spiderman quote. If you fuck up this royally, you have to look for something you are good at that allows you to be in stoner code bro mode all day long, but you don’t belong at the frontline.
> If an airplane manufacturer makes a dumb mistake, do you put their engineers in jail? No.
Yeah, they do. https://www.nbcnews.com/id/wbna28276654 Headline could just as well be Bogus AI Engineer jailed over safety checks.
> You do not understand the psychological dynamics at play here in the slightest. You aren't even trying to understand. If the government was anywhere close to this punitive with the AI companies, they would simply stop disclosing, the end.
I think you don’t understand. All an engineer needs is a bit of sunlight, food, and a computer to work from. You don’t get to choose to stop disclosing if the military gets involved. You’re either doing what is asked of you or you are a national security risk. And you really don't want to be a national security risk.
> You don’t get to choose to stop disclosing
That's just the thing. You do. And it's very easy to do.
Airline pilots no longer disclose mental illnesses. Even Air Force pilots do not usually disclose mental illness. They often don't disclose vision problems. Is that not a national security risk?
It is very easy to just... not check for things. Or if you check for things, to check for them incorrectly. Or if you checked for them correctly, to ignore or misinterpret the findings. Or if you have a genuine finding, to just not report it to anyone.
Disclosure is an active process that requires trust, and that trust comes from knowing that there will not be unreasonably punitive measures. That if you fix things in good faith and contribute to the safety body of knowledge, things will be okay.
It doesn't matter if "the military is involved." Or if "it's a national security risk." Do you think someone faced with life-altering punishment if they disclose gives a shit about that? They won't - again, see aviation's mental health crisis. Pilots will risk a psychotic break in the cockpit rather than have their careers destroyed.
Punishing people won't get someone to disclose. Disclosure requires mutual trust, and by throwing people in jail for mistakes, you break that trust and people will stop disclosing.