alt Hacker NewsWe Are the Last People Who Know How It Works
Comments
Just wait until they shred all the old useless books
Paging Vernor Vinge to the white courtesy phone.
Who cares?
There have always been layers of abstraction. I've been around for a while, and when I was a kid, the two choices I remember seeing were assembly code and simple semantic languages like BASIC.
Assembly seemed like too cryptic for me to really even follow and I never really did learn it, but at the time I remember people would say that assembly was easy and basically plain English compared to machine code.
As recently as fifteen or twenty years ago, I would occasionally check in and think of how unbelievably far away we had gotten from how the computer actually works. Like, you can just write "open window" and a window opens. Amazing.
Of course, those people writing machine code didn't need to really understand what P and N were in a transistor, let alone how an integrated circuit pulls it all together. And I'm not sure how much those guys knew about silicon dioxide.
The more complex things get and the more layers of abstraction there are, the more impossible it gets to really master things all the way down to first principles.
So what? People can carve out whatever chunk of the stack they want to really understand if they want to focus their lives on it. And for everyone else who's just trying to accomplish some other goal with computers as the tool, they will naturally use the highest level of abstraction and the simplest one for them to use, which is exactly what they should do.
[dead]
[flagged]
Competence Does Not Mean What You Think it Means.
Please don't fucking tell people that AI is competent. It is not and it cannot ever be because it is not alive.
This and it was demonstrated in Star Trek The Next Generation: Season 1 Episode 17 "When The Bough Breaks" [1]. They did not know how to fix their computer system or even where it resided. It did everything for them but was also killing them and making them sterile. There was nobody left to figure this out until the Enterprise crew happened along. This could happen on Earth. Who will save us?
> The knowledge is not in danger, in fact, it has never been safer. The AI models have read every manual that no human reads. They will recite, flawlessly and forever, exactly how all machines work.
That's wrong, and that's exactly why the loss of knowledge is such a problem. LLMs do not, and cannot, actually know a single thing. They are a statistical model, not knowledge. When they give out wrong information (and they always will, by their very nature), you need someone with actual knowledge to be able to recognize the BS and correct it. But we are losing the knowledge, and unless things change we will be no better off than the people in dystopian sci-fi stories who pray to the machine god because nobody knows how it actually works.