I don't think the statistics would bear out there being any way to make driving safer per passenger mile than public transport.

I get what you're saying. The empirical evidence just doesn't agree AFAIK.