The people OP is talking about, the 0.05% absolute worst drovers, are not merely complacent, they're doing things like getting hammered and going street racing (shamefully I can say, I was 19 once...) or speeding away from crimes etc
edit: someone else replied with data contrary to this, maybe they are right but Im leaving this here to represent the counterargument
The other reply doesn't contradict what you're saying. Someone who was street racing is going to tell the cops / insurance company that they were lost in thought.
It's a category error to say that everyone else are good just because they're not the worst you can imagine. It doesn't matter what your worst 0.05% do. It doesn't make most people actually good drivers.