In that case, maybe we should ponder putting 20GW of new fossil fuel power plants online just to power one new AI data center?

Or the resources spent on AI, which could have been directed towards decarbonization and solar build out over the last few decades...

I think AGI is the least of the concerns on the Humanity Bingo Card right now.

If you/we are collectively worried at what the repercussions of self directed AI, than that would be a first in the long history of capitalism.