The difference is that humans are at least supposed to be accountable for those 250,000 errors. Those humans can naturally care about doing a good job, or they can be motivated to care. They can fear consequences and take pride in avoiding mistakes.
AI can do none of this, and cannot be held accountable for mistakes.
I would take a human with a 10% mistake rate but who can be held accountable, over an AI with a 0.1% mistake rate that is totally unaccountable for its mistakes.
Human doctors and nurses are not accountable for outcomes, and they can not be accountable or our medical system (and any other medical system) would cease to function.
> I would take a human with a 10% mistake rate but who can be held accountable, over an AI with a 0.1% mistake rate that is totally unaccountable for its mistakes.
You would take those odds? 100x more deaths?
I agree that AI _companies_ should be accountable for the software they produce but I’m not convinced you would go for a 90% chance of survival if you can choose 99.9%.