Tool calling success rate, in the case of omp.
Can't edit my post anymore, but here's the omp blog from February talking about improved tool calling rates across 15 models, with only the harness being tweaked to get the improvements.
https://stencil.so/blog/the-harness-problem
Three GLM models are mentioned, but so is Deepseek, Grok, Minimax, Kimi, and Gemini.
alt Hacker News
Can't edit my post anymore, but here's the omp blog from February talking about improved tool calling rates across 15 models, with only the harness being tweaked to get the improvements.
https://stencil.so/blog/the-harness-problem
Three GLM models are mentioned, but so is Deepseek, Grok, Minimax, Kimi, and Gemini.