> Further, I would argue that coding is the only place it's made solid headway
Why? The company you work for seriously doesn’t do anything productive with LLMs?
How about search? Every big company I’ve worked for has some shitty enterprise search. LLMs have massively improved that situation.
They’ve also almost completely replaced L1 support at my company, the numbers there are way down just from people being able to find information they need. I don’t have broad numbers higher level support, but for a couple niches that I know about they are down as well.
For example, in a global company of 100k+ employees you’d be surprised how many support requests HR got just for PTO related queries, not even real problems. Now we have an agent that can fully manage your time off, has the policy documents for every country, pulls your data from the HR system, their number of support tickets are significantly down.
Another project I worked on involved automating some risk analysis stuff as part of the IT process everyone has to do when they develop or procure anything. After developing it for a couple months, then a few months running human in the loop validating all of the assessments, we have analysts manually audit 5% of them now. All of this used to be a shitty excel process, now is a slop web app. Cycle time is down from weeks to minutes because nobody has to wait on reviewers and the app can prefill most of the data from your general system documentation. Overall everything is just as or more accurate,
I know these aren’t very glamorous, barely considered real work by some, but in my feeble imagination there are many such processes being automated and improved everywhere.
> How about search? Every big company I’ve worked for has some shitty enterprise search. LLMs have massively improved that situation.
Using Glean at work and it's not much better than bad searches. It frequently gives me outdated information, or uses questions I asked in slack as answers to the same questions I asked in the LLM.