If you go back in time far enough, your logic can successfully be used to demonstrate the earth is flat.
"Could all these people seriously be wrong?" Yes, yes they could.