alt Hacker NewsYour point on the harness is interesting. How do you distinguish characteristics of the model from characteristics of the harness?
In the early days I feel it was more apparent. You would frequently see the model making failed tool calls etc.. but now that feels so rare. I'm not confident I can perceive whatever shortcomings of the harness remain.
Bit of a tangent but at work we have GitHub Copilot and the VSCode harness is somehow night and day better than whatever happens in the IntelliJ plugin. Aside from having better features, for some reason prompts seem to be cheaper as well.