Disagree, I think we do in fact have to treat AI models as capricious genies, at least until the alignment problem is fully solved.
(I'm also not sure the alignment problem is even possible to fully solve.)
Yes, we do, and the only sane strategy for dealing with a capricious genie is "Don't."
How do you prove the alignment problem is solved?
We call it putting the genie in the bottle for a reason.
Yes, we currently do have to treat them this way. But we shouldn't have to, and it's not a long-term solution.