logoalt Hacker News

walrus01 • today at 6:27 PM • 1 reply • view on HN

The deepswe and terminalbench4.0 scores don't seem to jive with what many opencode users' experience has been of this model while it was being tested as "space bunny". I saw a lot of anecdotes of people trying it and going back to qwen 3.8-flash-next or deepseek v4 flash because "space bunny" made some rather egregious errors.


Replies

penagwin • today at 6:44 PM

> [Space Bunny] was an early version of MiniMax M3.1 Flash.

They mention that space bunny was an earlier checkpoints, so it may have improved (or may it could be benchmaxxed)

I find it interesting that so many models seem to be at almost exactly 74% specifically which makes me suspicious of the benchmark. I want to say 5.6-sol, Astra, deepseek flash 4.1, opus 5 (and 5.5?), Gemini 3.8-flash and a few others all ended up there?

➕ show 1 reply