logoalt Hacker News

LinuxAmbulanceyesterday at 7:42 PM2 repliesview on HN

> All the AI companies are retaining the messages we're sending to their agents to train the next models. I wouldn't be surprised if the agents will be able to do what I'm doing in a year or two.

Some things are very easy to solve via code (see https://xkcd.com/1425/), and others are extremely difficult.

For LLM based AI, it can be trained to write functionally correct code easily - there's tons of pre-existing code and documentation that can let AI learn patterns (LAMP stack, messaging queue, etc) and syntax.

Judgement is much more difficult. For some things "Should I go with a message queue for this problem?", there's a known set of solutions as to what works best in a specific situation, sure, LLMs can answer that easily.

But when it comes to turning human goals into code that does the job correctly and is maintainable and stable?

That's a heck of a lot different. Without human guidance and having tons of context gained by years of experience dealing with the very nuanced and situational judgement calls needed, LLMs are going to fail at doing a decent job.

LLMs (and junior people) don't know what they don't know. I think it will be really difficult to get a LLM to work well at a senior / staff level where it's more about coordination, working with human beings, handling situations based on legacy code, knowing what will and won't be fragile, etc.


Replies

bnfclyesterday at 7:51 PM

Exactly, tacit knowledge is not easily added as AI training data.

asdfman123yesterday at 7:54 PM

> Some things are very easy to solve via code (see https://xkcd.com/1425/), and others are extremely difficult.

Note that comic is about a task that AI has already conclusively solved...

show 1 reply