More compute is already being used for inference than for training.
The new data centers are mostly for inference.