I spent an enormous percentage of my life very frustrated with other people because they couldn't just see the answer to things.
For example, I can put an engine into a car, and still tell you where every part of that engine is located relative to every other part, without being able to see it, including the internals, and describe, for example, over the phone how to troubleshoot it without being able to see it at all in person - just a mental model. And, for reference, I have almost no fundamental knowledge or experience with engines besides taking one or two apart - and it would not extend to other engines. It's been at least 20 years and I could still do it verbatim.
I'm way out on the end of that bell curve, but I'm not unique. I've worked with people who found that ability completely baffling, and would have to break out diagrams and blueprints to do that.
The gap is a lot wider than you think it is, it's not subtle, and this is known as the typical mind fallacy.
Edit: And funnily enough, further down there's a comment about Feynman realizing that his friend counts visually and he counts verbally - and I'm on the verbal side on that one, unless it gets complicated, and then I end up tallying mentally - but I have to count them verbally at the end.