logoalt Hacker News

teravor • today at 2:47 PM • 1 reply • view on HN

you don't need to post-train anything for this.

just get an LLM to think and then force it to output a specific json with prefill post-think.

make sure to include good conditioning text in the prompt with examples of exactly what the output should be like. you don't want dissonance in the probabilities on the prefill.


Replies

betenoire • today at 2:54 PM

A classifier is a subset of generative text, so I think responses like this miss the point. Jev is cheap enough and fast enough to sprinkle across your app in ways that LLM would be infuriatingly laggy and unnecessarily expensive, and it's never going to be injected to provide a sorting algorithm in python.

The point isn't that new type of problem has been unlocked, rather a new approach that can unlock new use cases.

➕ show 1 reply