alt Hacker NewsThe real question is whether it's easier to improve the software side instead. There are likely a lot more optimizations possible in terms of model architecture, and if there is a compute bottleneck, then it's going to put a lot of pressure on Chinese labs to address the problem using more efficient designs.
And one cool trick is that if one develops step function more efficient training, one can still “open source” the model without revealing the training techniques.