logoalt Hacker News

gavinray • yesterday at 6:29 PM • 2 replies • view on HN

Comparing the sort of models that would run on that to frontier models like Opus 5.5 or Astra is silly


Replies

kennywinker • yesterday at 6:48 PM

Astra and 5.5 came out in september, so I didn't compare to them I compared to "where the SOTA was less than a year ago".

But ok, let's compare: https://benchlm.ai/compare/gpt-6-astra-vs-qwen3-8-flash-next

Astra's score: 85.8/100

Qwen3.8-flash-next's score: 55.87/100

So there's a ~30 pt difference between them. Let's add 5% more for quantization damage.

My perspective is, yes - that's a huge difference. No - it doesn't matter. Flash-next is above the threshold of useful intelligence. I can ask it to do something and it does it. Sure, it burns some tokens on bad ideas on the way, and sure it can't turn a single paragraph prompt into million dollar business. I don't need or want that - I want something I can ask to refactor a module, and it does it and it doesn't stop until the module compiles and all the tests pass. flash-next does that.

➕ show 6 replies
chaosharmonic • yesterday at 6:36 PM

Assuming that you need frontier models like Opus or Astra for every use case that you'd throw at an LLM is also silly

➕ show 1 reply