It depends on whether the paper is simply wrong for some reason, or if there is either fraud or a fundamental mistake in the procedure. But in general you're right, retractions are not the way to handle most scientific disputes.

Your point about consensus unfortunately doesn't quite work in cases like this were the people using the paper are not scientists. They're not continuing work in the same area, people are using this paper to support their arguments.