alt Hacker NewsInstead of just dropping all the context, the system could also run a compaction (summarizing the entire convo) before dropping it. Better to continue with a summary than to lose everything.
Instead of just dropping all the context, the system could also run a compaction (summarizing the entire convo) before dropping it. Better to continue with a summary than to lose everything.
There's problems with this approach as well I've found
I'm really beginning to feel the lack of control when it's comes to context if I'm being honest