logoalt Hacker News

brainwad • today at 1:42 PM • 1 reply • view on HN

It means the weights by themselves can't learn. But they could be used in a harness that can learn in other ways. Insisting that it be done at the neural net level seems anthropocentric - because we form memories via neural connections, that everything else must, too.

Also: I wouldn't say a human with amnesia who relied on notes to their future selves lacks intelligence, so I'm not sure being able to form memories is in fact necessary.


Replies

ranyume • today at 2:08 PM

Even with a harness, there are things LLMs can't do. e.g. Write 50 entertaining short stories, each one completely different from the other but all sharing one motif.

In the example, LLMs choose the shortest path that would be verifyable by an evaluator. So the model is essentially blind to "entertaining" and "completely different". The LLM will output stories with different variations of the same structure.

If the LLM can somehow read other works and derive from them, it will merge the motif with the story being read.

➕ show 1 reply