It's much less the mechanism of AI than the potential policy implications.
That much concentrated data/compute is Checkov's Gun[0].
To assume we can find some policy lock for that gun is to believe the laws against murder preclude violence.
[0] https://en.wikipedia.org/wiki/Chekhov's_gun