This is the feeling i get too. Cant produce quality, but can produce something that is super fast...so take the wins where they are.
We don't have enough fast models, so I see this as a positive. I just test drove Gemini Flash Lite and it's crazy fast.
For a coding LLM specifically, when is fast a good tradeoff for quality?
We don't have enough fast models, so I see this as a positive. I just test drove Gemini Flash Lite and it's crazy fast.