If you are in taller than 95% for men, and reasonably fit, you might need a bigger waistline (think 36 or more), which is still the same length for pants (up to 34) with your socks showing even when standing (depending on your individual proportions), but much wider around hips and legs than you need. I imagine for shorter men, it's the inverse but equally bad.

Some brands will carry slim and extra long trousers, but if I find a model that fits (not all models from the same brand do), I immediatelly buy a few. Otherwise, I try to get tailored stuff, but that's slow and annoying.

For shirts, it's even worse: unless you can find an extra long version, you are going to be wearing a sail and your underpants/ass will pop out when you sit down. But these are easier to get sewed for you as you can just have a single tailor make many of them as needed.

So it's probably easier for median men, but sizes scale exactly the same without regard to actual proportions for simply bigger people.