I'm 55 years old and never thought about that, because the link never occurred to me.
But when Mrs first stood for Mistress, the word Mistress wasn't "loaded" at all.