I’ve also found that fast cheap models are more sustainable because they make it easier to keep technical debt under control. Partially because I’m keeping sustained attention in one place. And partially because small fast models with low reasoning don’t seem to love technical debt either and will (unintentionally) start to give you negative feedback signals when you’re letting things get messy.
I’ve also found that fast cheap models are more sustainable because they make it easier to keep technical debt under control. Partially because I’m keeping sustained attention in one place. And partially because small fast models with low reasoning don’t seem to love technical debt either and will (unintentionally) start to give you negative feedback signals when you’re letting things get messy.