One slight problem with that: drivability is actually better.
Let's say you have space for two lanes. You can either a) install two car lanes, so >95% of people drive, or b) install one car lane and one bike lane, so 75% of people cycle. Which one is more drivable? Hint: it's the one with significantly fewer cars.
Similarly: car infrastructure takes up a lot of space. If your destination is 10% closer because cycling means far less car infrastructure is needed, you'll actually end up driving there faster.
A street's car traffic capacity is far less important than its total traffic capacity, and the last-mile driving speed is a rounding error on the whole trip. If you like driving, you should be in favor of building more bike infrastructure!