logoalt Hacker News

cadamsdotcom • today at 1:38 AM • 2 replies • view on HN

> As we focus more on memory, we also need to think about strategic forgetting. Over time, overly precise memories become conflicted and messy, and nobody has yet figured out how to handle this.

> I think that’s the context problem of tomorrow.

This passage is explains why humans have imperfect memory. Seems the perfect memory we wish LLMs had impedes creativity and is maladaptive.

Strategic forgetting helps put the non-deterministic machine to best use. LLMs don't need perfect memory; that's covered by the computer itself.

I like that this justifies the continuing relevance of context engineering - a seemingly dated term - in the face of trends like loop engineering.


Replies

jphorism • today at 3:08 AM

actually, I think agents have a lot to design after Zettelkasten yet. It's the concept of having an append-only policy and gardening to consolidate knowledge. IMO we've seen some, but there is still so much potential

➕ show 1 reply