> they have no way of knowing if the AI is bullshitting them
That hasn’t stopped Tesla. Their self-driving cars work by connecting the car’s controls directly to a neural network.
They have world simulators which verify, to an extent, the behavior of the software
I thought that pretty much every self driving algorithm in production was based on machine learning of some sort.
For those who won't act ethically or at least reasonably, regulation is the answer. We're not too far away from flipping the congress into something far more willing to do just that, especially with anything connected to Elon Musk.
And they're still a decade away from general road use outside of vetted streets. Tesla is still struggling with pedestrian detection in rain tests.