alt Hacker NewsLLMs are writing as well as humans for people who think writing words is the goal. Printing presses also write words better than humans. LLMs are solving the problem one layer higher than printing presses, but still several layers down from the top.
Note that LLMs aren't useless, since they have other strengths which can make them equal or better than humans in certain applications. For instance, they can tirelessly review code for silly mistakes, making them useful in cybersecurity.
Replies
Right. LLMs are text production machines.
You can also view them as data expansion tools. They expand an input to an arbitrary long text. That text contains roughly the same amount of information as was contained in the input to begin with.
This is not very useful unless your work is content production. More useful is when the output length is shorter than the input. Then it is a (lossy) data compression tool. These are, as we all know, very useful for images and sound but now we have them for text too.
I really want to know what people specifically mean when they allude to some "higher" level of cognition that humans have above LLM's when it comes to useful outputs. I don't mean the nature of consciousness or internal experience (which is unfalsifiable), I mean the essence of cognitive labor as a tool: writing is about relating concepts, drawing comparisons, aggregating elements of reality into a fictive but believable narrative.
All these processes can be reduced to mathematics and computation. The human brain is just a tool, like any other organ. Do we deny this reality because it shields us from existential horror?
He talks about this in TFA:
Yo, this blog post could’ve been a freakin’ prompt. I have years and years of blogging for an AI to learn from, and over 20 novels, and tons of short stories. One prompt, and all this spills out. And if your goal is a blog post, you’re gonna love this era. If your goal is the joy of thinking in words, nothing has changed. So this is the real part, right here: Doing a thing for the love of the thing is no different than it ever was. The problem is, there aren’t many people for whom this applies.
> LLMs are writing as well as humans for people who think writing words is the goal.
Only if what you mean by this is "for people who think padding a word count is the goal".
LLMs absolutely do not write well, by human standards.
Huh that is an interesting metaphor. A next higher layer printing press?
a great point, and I think a very rare one
I’d be interested to know what you think the “several layers” above a system that solves open mathematical problems in an afternoon, and writes entire operating systems from scratch, are.
Finally, someone else understands that writing is not the goal, the entire point of all of this is our communications between one another and this market for narrative stories is a nice departure and it does convey important knowledge and moral lessons that larger society needs. But it is an indirection, an indirection to the mission of communicating solutions to how to live as a human and that is why we care, why the interest persists despite lifetimes of narrative dreck. We are adrift without instructions, and no religions are not the instructions.