logoalt Hacker News

dannyw • today at 12:48 AM • 0 replies • view on HN

World knowledge, factual recall without grounding, more complex instruction following, etc.

Benchmarks don’t really tell you much. For API best will always be a model+effort sweep on your internal evals (and if you don’t have internal evals, do that first).

For individual coding harnesses, honestly I just go with vibes. The best workflow is the one that works for you.