Sports already exclude most people as they're not performant enough. So I don't see a problem with excluding biological males from female sports.

But, we should compare actual body parts that are relevant, for example I'm male but I'd not belong in male sports as my body is more feminine..

Still, it's not who you think you are that should decide, it's the body type so the competition can be more interesting as that is the point of sports anyway..