That was the preview model right? This one appears to be significantly better.

I mean it's still a small model, but at least the benchmark scores (incl. on DeepSWE) went up significantly.

It costs as much as Flash, but the benchmarks are on par with Pro (or above in some cases).

Of course, benchmarks are mostly meaningless -- the only real benchmark is the actual work you give it :)