I can only suggest reading the letter with open mind and literally, without uncharitable bias towards the authors or conspiracy mindset.
Its not a conspiracy. Its 25 fields medalists who think exactly like how I put it. Ideally, they can just take whatever the technology gives as soon as possible and use it. They don't want it because they don't think the community can rearrange and coordinate such that they can make use of the new found degrees of freedom.
That's literally all there is to it - they don't believe in the rearrangement.
FWIW it didn't sound accusatory to me, it made me think the anti tech people might have a point.