Yeah, if a tourist refuses to have a Suica/Pasmo card, they're going to be quite inconvenienced.
Also, Mt. Fuji Station and Fuji Station are 2h30m apart: https://www.google.com/maps/dir/Mt.Fuji+Station,+2+Chome-5-1...