logoalt Hacker News

girvo • yesterday at 11:02 PM • 1 reply • view on HN

They are? In all my evals at work, Jev seems to win, despite me wanting the open weight versions to.

I imagine if I fine tuned one of the open weight models for my use case it would be possible to beat it, though, but as a general drop in decision model, I’ve not really seen much that beats it especially for the cost


Replies

inerte • yesterday at 11:11 PM

Same here, and I have a project 100% hosted in Cloudflare ecosystem (AI Gateway, Workers, Queues, R2, D1, DO, etc) I was so happy when I saw clef. Tested, and it's bad. Slower and wronger than Jev.

Still waiting on Decisions API using Luna, as this what I was using before.

Run your own evals, folks.

➕ show 1 reply