Luna 6 is getting a bit long in the teeth now. It's two full months old, but it was only a slight step above Luna 5.6, which is already four months old (Imagine saying this about anything else). So I'm not too surprised that a newer small model is beating it handily. I've been hoping for Luna 6.1/2 as the next model release for a few days now.
> I've been hoping for Luna 6.1/2 as the next model release for a few days now.
Same. It became my workhorse after the 5.6 price drop. Still so, although it's showing its age, as you said.
Tbf, I would take Luna 6 baked to silicon. It is that good. I would also take kimi k3 baked to silicon.
These are both models that I could see using on a long horizon.
> Imagine saying this about anything else
Javascript frameworks, circa 2016 ;)
Uniquely among models I've tried, Luna 6 is infuriatingly lazy. As if it expects me to do the work, unaware that it is a tool. Normally dumb models compensate for it by trying harder. This one goes in the opposite direction.
Give Terra 6.1 Low a spin in places where you'd have previously used Luna Max. Costs seem similar, due to Terra being much smarter: thus requiring far fewer tokens per task.
Looking solely at AA's intelligence index, recognizing the pitfalls with using that as a measure- Luna 6 Max > Terra 6.1 Low is 51.3% cheaper, 94.1% less output tokens, for 1.56 higher index score.