My guess would be that this has more to do with disk speed if your download speeds are decent. Especially if it’s wired to the internet rather than WiFi. It’s always easy to spot the console user in cross-platform lobbies because of the loading times.
The write speed of the PS5 SSD is indeed quite bad but it's still way faster than gigabit ethernet, it can't be the bottleneck. It also can't be the bottleneck with load times, it still reads at 5000MB/s even though it writes at 1/10 that on a good day.