You’re making several logic errors.
“Treat everyone from there as a criminal”. You’re not being treated as a criminal you just can’t use a VoIP number.
And for your example, if the neighborhood was known for car thefts, and a major theft happened, it would make sense to assume your suspect is from that neighborhood.
No, it wouldn’t “make sense”, it would be “prejudicial”.