logoalt Hacker News

codazodayesterday at 10:00 PM2 repliesview on HN

I can't get Codex CLI or Claude Code to use small local models and to use tools. This is because those tools use XML and the small local models have JSON tool use baked into them. No amount of prompting can fix it.

In a day or two I'll release my answer to this problem. But, I'm curious, have you had a different experience where tool use works in one of these CLIs with a small local model?


Replies

zackifyyesterday at 10:23 PM

I'm using this model right now in claude code with LM Studio perfectly, on a macbook pro

show 1 reply
regularfryyesterday at 10:10 PM

Surely the answer is a very small proxy server between the two?

show 1 reply