alt Hacker NewsIt's very interesting, because on one side we have clear data showing that autonomous cars at the Waymo level are safer than humans.
On the other hand we don't give technology the same pass we give to humans, meaning that we don't tolerate machine incidents the same way we tolerate human ones.
Which means that self-driving cars need to be a magnitude of order safer than humans.
And even though a self-driving car will never road rage or use the car as a weapon on christmas markets, we'll still tolerate humans driving more than one odd 1-in-a-billion ai-error caused incident.
Replies
> a self-driving car will never … use the car as a weapon
You are lacking in creativity and vision. With networked autonomous vehicles, all cars can be used as a weapon simultaneously.
> or use the car as a weapon on christmas markets
On the contrary, autonomous vehicles (especially if something like automated package delivery becomes an offered service) allow car bombs without the suicide bomber inside. Instead you just place an explosive in the device and send it to the intended destination - as an organization the primary concern then becomes whether the ride is traceable back to you which might be do-able given how "frictionless" rideapps are as long as you get a burner phone, prepaid credit card and are very careful about making sure the device is clean and can't be tied to your person.
Right now the tech is limited to places where carbombings aren't commonplace, but I think driverless cars open a huge potential issue in other markets. I absolutely agree they're safer than drivers are, but let's not be hyperbolic.
> meaning that we don't tolerate machine incidents the same way we tolerate human ones.
Any company that builds self driving cars or operates them should show how reliable they think they are. Not by showing pr material or stats, that's all 'free'.
Make yourself, as the company, legally liable. If you think it's good, put your name on it and own the risk.
When that happens, I'll trust whoever says it's safe.
When a human driver messes up, there's a person to hold responsible. When a robot car messes up, who is held responsible? If the human messes up to the point they are no longer allowed to drive, that person is no longer on the streets to cause more mistakes. When a robot car messes up, are all of the other cars pulled off the streets as well until the glitch is fixed? Every robot car is essentially the same driver.
If a human makes a mistake, we give them the liability to own up to their mistakes, and carry the costs.
Most self-driving enterprises are trying very hard to ensure their non-driver continues to carry this liability instead of their company.
This helps a them v. us attitude. The company needs to be trusted widescale by the public, and do seem to undercut their own PR efforts on that, repeatedly.
> On the other hand we don't give technology the same pass we give to humans, meaning that we don't tolerate machine incidents the same way we tolerate human ones.
It comes down to accountability, IMO. We tend to be forgiven to humans because we are humans too and we know we, humans, make mistakes, and these can have serious consequences.
When a human makes a mistake, they are immediately accountable, and therefore judged and forgiven (or not). When technology makes a mistake, who's to blame? The CEO? The software developer who wrote the code? The tester? The architect?
Yes, we want technology to be an order of magnitude safer than humans for this reason, because we know that, given the current way our judicial system works, when technology makes a mistake, no one is held accountable.
> On the other hand we don't give technology the same pass we give to humans, meaning that we don't tolerate machine incidents the same way we tolerate human ones.
I completely disagree with this. I don't "give a pass" to humans killing other humans with a car.
Every year that skeptics delay adoption of autonomous driving is another year where tens of thousands of deaths could be prevented.
We don’t tolerate machine incidents because who is liable if an accident occurs? A company with a $4.6 trillion market cap? They’re not a legal opponent any of us really want to take on.
> we don't give technology the same pass we give to humans
This was the hypothesis. But based on e.g. FSD, it doesn’t seem borne out in reality.
> a magnitude of order
unless I'm missing something, you meant "order of magnitude"
I don't think you can just look at the statistics though. What I mean is that, the main issue is that the category of mistakes they make are going to be inherently different from the category of mistakes that humans make. IE, humans are more likely to make emotional mistakes, but self driving is probably more likely to make perceptual mistakes or fail to respond to novel situations. I think the "fail to respond to novel situations" is probably the biggest blocker for people to trust them enough for widespread deployment. I'd love to see one of these things drive on a poorly mapped dirt road up in the mountains, for instance (I'm not saying it can't -- I just mean I would personally love to see how it can adapt to that kind of situation)