No, that's a direct consequence (intended or not) of how RLHF works.