These models exist because better models exist, these models can't exist without better models existing, you will never beat the frontier with smaller model sizes. Because all these models are trained again larger models, generally a teacher model of sorts.
Lots of synthetic data, distilled data etc.
The problem is if we can pack a Fable in Qwen 4 27B who will pay subscription prices?
alt Hacker News
These models exist because better models exist, these models can't exist without better models existing, you will never beat the frontier with smaller model sizes. Because all these models are trained again larger models, generally a teacher model of sorts.
Lots of synthetic data, distilled data etc.
The problem is if we can pack a Fable in Qwen 4 27B who will pay subscription prices?