logoalt Hacker News

Tanjreevetoday at 4:33 AM1 replyview on HN

That bug is fixable and verifiable. The LLM you cross your fingers till the next time the same thing happens.


Replies

egeozcantoday at 5:10 AM

> fixable and verifiable

By people with a specific skill set. LLMs generation can also be fixed and verified by people with a certain skill set, and non-deterministic computing doesn't automatically mean unpredictable. When people say that the LLMs are a black box, it means unpredictability in unknown situations.

You do structured output, input validation, output validation, lower temperature, limit decisions, RL, etc. to increase predictability to near certainty. It's just statistics after all. Or you can as well generate the code to do the job.

It's just that the required skill set is a different one to do those things, and unusual in the context of DB administration.

show 2 replies