Why would we choose a more expensive form of energy rather than cheaper forms?

There are good reasons to choose more expensive things, but "nuclear sounds cool" is not a good reason. There must be some sort of rationale and benefit beyond that.