I doubt it will change much, inference (not training) is very profitable and demand for inference is quite high. See: Mistral serving GLM on their own servers.

They're too big to fail at this point. US taxpayers will bail them out if push comes to shove.

In that unlikely case, open-weight hosting providers (and Google and Meta and SpaceXAI) would pick up the slack.

The only chance of memory demand going down would be breakthroughs in model size reduction.

They are probably too big to fail already (and too friendly with the current US gov). And even if they fail, open-weight models will take over as the usefulness of the tech behind has been proven.

Sure, and they'll be cognizant of that risk when considering expansion. The lessons of the dotcom fiber boom aren't that distant in memory.

If AI companies have allocation of memory, can't they just sell the memory allocation if they are tight on cash?

I don’t think they will. There is too much money in it now.