logoalt Hacker News

chpatricktoday at 4:46 PM3 repliesview on HN

Could someone explain how Jev is different from using any old model and constraining the output to "My choice is a/b/c..."?


Replies

xigoitoday at 8:57 PM

The model can spend more “mental energy” on the decision because it doesn’t have to spend any on phrasing the output.

jimmyl02today at 4:57 PM

The argument the article makes is it's not that different. Jev's argument is that they have trained the model to better output probabilities (which is not necessarily a training object of LLMs but we don't actually know that)

Ultimately Jev claims to have a data advantage which is likely where the future lies. They'll have a unique edge in improving general purpose classification / decisioning.

kccqzytoday at 7:37 PM

If you believe the marketing, constraining the output this way can make the model much faster and much more type-safe (the model didn’t give you a fifth choice not present in the choices).