You’re forgetting that keeping the context small is better economically and delivers better results.
I learned some nuance. Small context is important if the context isn't cachable. If most of it is the same prefix every time, the situation changes pretty significantly.
Forgetting? I think you mean to say your advice was auto-compacted to keep our context small and deliver better results.
I learned some nuance. Small context is important if the context isn't cachable. If most of it is the same prefix every time, the situation changes pretty significantly.