I don't even think this is an extrovert/intropvert thing completely, so much as what people are used to/how they were brought up.

Some people are very concerned with appearances and therefore uncomfortable with people in their homes (in either direction - too shabby, or flaunting).

Other people (with some overlap with above) are too OCD? about planning and so they turn hosting into such an ordeal they are overwhelmed by it.

In general I find that while I am an introvert, hosting a group isn't really a big deal. I find 2:2 with another couple to be more draining than a group of 10 in terms of being able to step away and catch a moment of calm. Further, as a host .. I get to select who is coming in the first place!