Opening line:
> A core hope for managing AI risks is that AIs will help us understand our situation
Gonna stop you right there and ask that you think deeply about that premise.
This should be the top comment, the implication is: AI will decide if AI is correct or no, so adding a new layer of approval...
Whenever you say, hey that's incorrect, the legal process goes to AI and will decide on that issue...
Will work as amazing as the chatbots of the AI companies to solve your issues...
That's what we've been doing with tech for 200+ years, why would it stop now. Build cool shit now and let future generations handle the problems
That begs the question, what's the plan if AI does not help us understand the situation?
I love how many ways we can interpret that line.
"Hey Claude, our stuff needs to make more money. We are at risk for losing more."
"Rest assured, the 'situation' will only worsen if you resist our benevolent offer."
"We're aren't even at AGI yet, but I for one welcome our new agentic overlords."
The underlying idea is that AI capabilities will become so advanced that only AI will enable us to monitor/correct/understand behavior. Obviously this is not without issue and I don't want to try to defend their position right now. But that's what they mean