no, you do see along the fourth dimension when you're pointing that way. i think you have a deep confusion here actually, but i can't really help because i don't actually understand your confusion. but, for whatever help it will be:

- all the dimensions are treated the same

- you only actually see two dimensions.

(it goes without saying that it's actually me who's confused.)