logoalt Hacker News

CharlieDigital • today at 6:39 PM • 1 reply • view on HN

No one mentioning Decisions API?

Feels huge. Sounds like Luna on their Ultrafast infra.

I did some internal benchmarking and found that GPT 6 Luna in batch mode at 20 records per batch was about 1.6x faster at 1.2x the cost of Jev with no tradeoff in accuracy. Tuning it up/down would make it faster per-record while also reducing the cost (assuming accuracy holds). Though this was only useful for offline processing.


Replies

dudus • today at 7:46 PM

It's another Jev copy, like we've seen so many over the last few weeks. But with no benchmarks or price comparison, which likely means it doesn't compare that well.

➕ show 1 reply