They don't even need to. If you observe enough of them you can correlate traffic patterns between them and find out which one is used by which endpoint