> This is like building a new gun as you tell everyone about how dangerous guns are and how they will destroy all of us.

That's correct, that is what they think they're doing. It's based on a new religion invented by Big Yud which says we have to invent good computer gods or else there won't be anyone around smart enough to fight evil computer gods.

It is possible (likely) this was a bad idea, but you can't undiscover math once it's discovered. And it did work out last time:

https://en.wikipedia.org/wiki/Mutually_assured_destruction

…so far, anyway.