I always got the impression that it was somewhat of an open secret that most billionaires had soft harems of sorts, usually tacitly understood but never publicly addressed, and that the apparent outrage at affairs/scandals at this level is a sort of charade of allegiance to social norms to enforce the facade that standards of propriety apply even at the highest levels.