> If my blood pressure crashes because my nurse is caring for 15 patients at once and didn't notice that the AI decided to pause my norepinephrine, I won't consider "the AI did it" to be any acceptable excuse.

While not quite as direct as automatically stopping vasopressors, using proprietary prediction models touted by vendors to be safe has backfired in a major way before:

https://jamanetwork.com/journals/jamainternalmedicine/fullar... https://www.statnews.com/2021/09/27/epic-sepsis-algorithm-an...