logoalt Hacker News

MattSayarlast Thursday at 4:58 PM1 replyview on HN

I recognize the sarcasm. The data I can find says it's performing at baseline however?

https://marginlab.ai/trackers/claude-code/


Replies

ACCount37last Thursday at 5:07 PM

Yeah, that's my point. Humans are not reliable LLM evaluators. "Secret model nerfs" happen in "vibes" far more often than they do in any reality.