In parts of Asia it is "expected" that a successful politician or businessman will have a "second family". I'm thinking the spying part (Huang is from Taiwan and was possibly leaking info to China) is considered worse than the cheating part by everyone involved.