Maybe the trans men issue gets less attention because they have already been excluded from both women's and men's events?

I assume trans men are administered testosterone as part of their medical care, and that's already universally banned from competitive sports.