That's exactly what RLHF is for.

(In fact, "that colleague" might have even been the source of the RLHF training set.)