logoalt Hacker News

rootusrootus • today at 1:15 AM • 6 replies • view on HN

I guess what I really want to know is how Gemini 4 Neon w/Antigravity compares with Opus 5.5/Claude Code. I'm not really into using LLMs in a particularly advanced way, I just use CC like 99% of the time when I need to write something, and then maybe Codex to second guess it.

But that's about as complicated as I get. I have recently tried to use Copilot because that is what work wants us to use, and even with Opus 5.5 it is noticeably inferior to CC on the same model. Wild. So clearly the harness matters.


Replies

scottyah • today at 1:33 AM

The models can be very optimized for the harness, Clem (of Hugging Face) just recently released a Qwen3.8 model that used RL training on the harness and it got some pretty significant gains in the benchmarks.

- SWE-bench Pro (hard 51): 39.2% → 64.7%

- Terminal-Bench 2.1: 39.5% → 55.8%

https://huggingface.co/harness-hub/Qwen3.8-27B-pi-adapted

➕ show 1 reply
seizethecheese • today at 1:21 AM

Totally possible for your use case, though the analyses I’ve done on harness model interactions show it’s actually not that important for benchmark performance. https://micjm.com/blog/on-model-harness-interactions/

For what it’s worth, the linked article data (Agent Duel data) is all run on OpenCode. I’m curious if people would prefer we run each model in its native harness (at the expense of user experience because it’ll be buggy).

thefunnyman • today at 1:23 AM

We had CC for a while and now have to use GHCP. As such I haven't used CC in like 6 months but around the time I switched I felt like GHCP CLI had pretty much caught up. Curious to hear what you feel are the gaps? Are you using the cli versions of both?

➕ show 1 reply
anukin • today at 1:44 AM

Antigravity in general is a poor harness. I have had better experience using Gemini 3.8 flash over api than using it over agy.

TacticalCoder • today at 2:01 AM

Ah that's a new angle. After the "Google models are behind" and the "Google models are slower" and the "Google costs more per tokens", we're now at the following phase:

"OK, google models perform just as well, are faster and are cheaper but all that doesn't matter. Because the models, now that Google has very good ones, doesn't matter after all. All that matters is the harness".

And of course it's upvoted by the Anthropic shills.

pritambarhate • today at 1:26 AM

Also last I checked there was no clear flag to turn off training in paid plan of Antigravity. So if you care about that looks like Google doesn’t want you as their customer.