alt Hacker NewsI honestly was worried for them. Now, even with all the clones, they generally still come up on top in price and latency, but "good enough" is often sufficient.
Guess the (investment) market has spoken.
I honestly was worried for them. Now, even with all the clones, they generally still come up on top in price and latency, but "good enough" is often sufficient.
Guess the (investment) market has spoken.
Hm? Jev's actual (network) latency is not that great and even small local models are doing far better latency-wise.
The Microsoft article GP linked even shows the MS model having 95ms latency.
Even on price Jev being matched (the same MS model is "Input tokens cost $0.042 USD per million tokens. Output tokens are free.", same as Jev).
Cloudflare's Clef-flash model is actually slightly cheaper: "$0.038 in / $0 out per 1M" too.
Jev is being matched or exceeded in performance and price within a month of them going public.