Is this "compute is a moat" true though? Why are the economics so obfuscated? Where can we see how much money it costs to TRAIN various models.

https://hugovergnes.github.io/little-lm-3-8b/

The training and cloud costs are often conflated. R&D costs too (which are hard to compare to open systems).

A lot of compute is clearly "wasted" where they are not focusing on optimizations, etc.