logoalt Hacker News

hnlmorg • today at 6:28 PM • 1 reply • view on HN

All you’re proving is that any specific domain will have a dozen mature solutions.

What separates one product from another is going to be constraints specific to the project you’re integrating this into. And none of that is defined in your prompts. So you’re effectively just asking an LLM to roll the dice and pick something at random and then acting surprised means a different answer each time.

Edit: their conclusions at the end of the article miss the most important point. They talk about asking multiple times over multiple days, but that’s just repeating the “garbage in -> garbage out” cycle without addressing the root cause of the problem: not defining your requirements properly.

And if you don’t have any requirements beyond “something cheap” (for example) then who cares what answer you get when any result is equally valid for your use case.


Replies

avatar99 • today at 6:32 PM

[flagged]