It’s already a (very real) crime to do a Conspiracy to deprive someone of their civil rights, which is what you’re talking about. Occasionally someone gets sued under it, but it’s rare.