alt Hacker NewsWhat is the point of this, if it is p90 17 seconds? Might as well use an LLM. The beauty of Jev is that it is dirt cheap and insanely fast.
Replies
amelius • today at 4:14 PM
Next step: make it classify the next word.
esafak • today at 1:18 PM
Jev ought to offer a flex mode that uses their spare capacity for a discount.
I would hold your horses to paint it as dirt cheap.. In my cases for spam detection Luna was 20% cheaper due to prompt caching, although not as fast.