logoalt Hacker News

biggc • yesterday at 5:07 PM • 1 reply • view on HN

And then another agent swarm to make sure that the research swarm didn't hallucinate any false positive matches!

LLMs are great, and they keep getting better, but I'm so tired of current shortcomings being blamed on the prompter "holding it wrong".


Replies

hirako2000 • yesterday at 10:39 PM

You are supposed to use at least one LLM as judge for all output, in xhigh reasoning. Also important, is to run regular sample validations of output vs predefined input to ensure the model doesn't regress on your kind of data.

That process won't catch everything, but is worth it. that's how to "hold it right".

/s