This was the logic for developing the atomic bomb and it was a good call.
Was it? We nearly destroyed ourselves with nuclear weapons several times in the last century. I don't think it was a good call just because we've gotten lucky so far.
The development lead to it being dropped on two cities followed by an arms race that put global civilization at permanent risk, with several incidents already that could have launched a nuclear war between superpowers.
How is any of that good?
After the war, it turned out that the Nazis weren't even working on a nuclear bomb. So had the US not done it, nobody might have. Other nuclear powers did it only because the US had them and had shown that it was possible.
Sort of, although didn't Von Neumann package it slightly differently - less personal (someone else) and more about the evolution of science and separation of roles of scientist and politician... basically science is going to happen, and it's not for people like us (scientists) to be worry about what happens as a result.
Still seems a moral cop-out, and while true, the timeline would certainly have changed, if not the inevitability, if key figures such as himself had opted out.