alt Hacker News> The foundation so far has been one of brute force scaling.
In cloud AI, sure. But in the smaller open weights model territory it feels like we're well into optimisation?
> The foundation so far has been one of brute force scaling.
In cloud AI, sure. But in the smaller open weights model territory it feels like we're well into optimisation?
Why do you think cloud AI doesn't also use these optimizations? They are also compute-constrained. I expect optimization and scale have a multiplicative effect. Surely all the serious players care about both.