LIDAR also struggle in heavy rain, snow, fog, dust. Check how waymo handle such conditions.
It's not only failing, it's causing false positives.