> The cost to train and infer that would be insane, even by today's standards.

This assumption is likely what has led to the erroneous failure.

Enterprise compute per rack has scaled multiple fold in the last 3-5 years. Alongside the training efficiency gains & datacenter scale increases, even 50T+ is well within reach at the top end.