logoalt Hacker News

soninkyesterday at 2:46 PM2 repliesview on HN

Spent a lot of time - but this makes zero sense to me. It can, maybe, return type safe outputs faster than larger llms - but there is little reason to believe that it will be more accurate. It does absolutely hallucinate - and seems to me that the claim is largely misleading.

You architect your systems with typesafe - because it is marginally faster, but inaccurate - to do what ? You can just wait for the next version of LLM's to get more accuracy at the same cost - or just use a faster model right now from a different provider.


Replies

bigmadshoeyesterday at 3:47 PM

It isn't marginally faster, it seems to be approx 100x faster and 10-100x cheaper.

brooksyyesterday at 3:29 PM

For certain tasks, a model like Jev may be intrinsically more efficient than an LLM because it doesn't have to predict a token distribution and can instead focus solely on the probability of a single question/action