They were too busy at a wellness retreat to respond to the brewing drama