These models are autoregressive so I doubt they are running them across multiple clouds. And besides, a pause button is useful from a user's pov.