Interestingly CVSS was designed to help with this specific issue. You are complaining that the system is imperfect, but you fail to imagine how it works without such a system, everyone tagging their issue as critical.

CVSS is good, it's better than nothing.