logoalt Hacker News

qalmakka • yesterday at 11:11 AM • 3 replies • view on HN

A gut feeling I've been having since the start of the LLM era is that horizontal knowledge (aka, knowing that stuff exists, can be done in certain way, being able to understand the details without knowing them intimately and being able to do it with a wide array of things) will start getting more and more important the further we go in, because if you know that stuff exist you can point an LLM at it or get it to go in a specific way that it wouldn't take otherwise. LLM have a very strong tendency to just go from point A to point B, and they're often limited to what you can prompt.

This is basically the opposite of the last 50+ years where vertical knowledge (being a savant in a certain very specific field) was seen as the most important thing to have in a super specialised world.

This of course is just my perception, which needless to say, may be wildly off


Replies

poopingatwork • yesterday at 2:17 PM

It's all about how much crap you can fit in your head without going crazy.

Either you fill it with vertical knowledge (which sucks because now AI wipes out a lot of specialists), or you fill it with horizontal knowledge.

Vertical knowledge is the deep silo of learning that comes from doing more advanced techniques to deal with increasingly difficult problems.

Horizontal knowledge is knowledge about process and workflow: where does the thing created by vertical knowledge fit on the bigger picture? What systems are integrated from left to right to keep you successful?

It may be that a successful developer is now a specialist in general technology.

Silos between specialists were always talked about being broken down but the truth is breaking down a silo means asking your specialists to do more work. You don't get to be a developer anymore, you must also take on operations for successful devops.

It may be that AI finally allows broken silos to be successful because AI removes a lot of friction that occurs when context switching between silos of specialists. And quality may mean more complex interactions and integrations, which increases difficulty of operations (notice a trend in outages lately?).

Then the question becomes: who is still creating quality with all these new tools?

Because at the end of the day, everyone wants maximum quality for the cheapest cost.

➕ show 1 reply
kapep • yesterday at 11:17 AM

I'm so sure about that. LLMs seem to have that tendency when people ask them to solve a certain issue, but they are just as good for providing an overview of a topic - or even better, because details don't matter as much.

alex_smart • yesterday at 11:24 AM

Isn’t the LLM already better at broadly knowing everything that exists than any human could ever hope to be?

➕ show 4 replies