logoalt Hacker News

b112 • today at 6:39 AM • 1 reply • view on HN

LLMs have a bottleneck, human review. And human review is absolutely required at this stage (the future is unknown). A rust built LLM only reviewed SSL library would be a recipe for disaster.

Beyond that, when it comes to exceptionally complex APIs, forward thinking implementation, and revising the 'way things are done'? These are weak points for LLMs. If you don't know how to write OpenSSL(or its replacement), and don't understand all its quirks, and the entire industry surrounding it, you cannot be the human driving the LLM successfully.

There is no way for a human to catch all the design mistakes an LLM will make, otherwise.

People seem to get upset, when I say this, for reasons I cannot fathom. However, we need to have a mental model of how we trust LLM output, and the 'new junior' is great for that. Especially considering that every day, is a new day for an LLM, its context window always loses yesterday.

So consider LLMs as an eager, intelligent, incredibly well read junior, just out of college. And on their third day of work.

Zero real world experience. Constant review required.

Would you want that junior to design, build, and write test scripts for a library to underpin the entire internet?


Replies

pseudohadamard • today at 7:54 AM

> A rust built LLM only reviewed SSL library would be a recipe for disaster.

There was a great quote at this year's OpenSSL conference that went something like "LLMs if left to their own devices will reinvent sendmail".

➕ show 1 reply