The only reason this would be the case is if you are using network hubs or some ancient early 200's network equipmemt.
And hubs like that wouldn't work with 1G anyway. (Apparently theoretically some versions of gigabit ethernet could work with hubs but it's not clear any were ever made)
Buffer exhaustion can cause it to happen pretty quickly with some normal, non-contrived usage patterns. A 10G host sending large data to a 100M peer will cause all packets between all other peers to drop once switch memory is filled up. Ideally the switch is smarter about this, but cheap switches in the real world…