You should read Time by Stephen Baxter: https://en.wikipedia.org/wiki/Time_(novel). Part of it deals with this precise topic.