Yes I can, no problem. First figure out how consciousness works and tell me, then I'll be able to explain if the software is ethical or not. Its simple really.
As we don’t know yet, it has to be determined by the balance of probabilities; but even if the weight of evidence leads us to conclude that-there’s-no-consciousness going on when you run this, there’s still going to be a chance of us being wrong, let’s say 10%… Is the utility (…or entertainment value) of this program worth a 10% chance that we confidently, yet unwittingly, create perhaps the most cruellest machine it’s ever possible to make, and then have to live with ourselves?
As we don’t know yet, it has to be determined by the balance of probabilities; but even if the weight of evidence leads us to conclude that-there’s-no-consciousness going on when you run this, there’s still going to be a chance of us being wrong, let’s say 10%… Is the utility (…or entertainment value) of this program worth a 10% chance that we confidently, yet unwittingly, create perhaps the most cruellest machine it’s ever possible to make, and then have to live with ourselves?