logoalt Hacker News

stingraycharlestoday at 6:05 AM2 repliesview on HN

You’re forgetting that keeping the context small is better economically and delivers better results.


Replies

bob1029today at 11:20 AM

I learned some nuance. Small context is important if the context isn't cachable. If most of it is the same prefix every time, the situation changes pretty significantly.

themgttoday at 8:26 AM

Forgetting? I think you mean to say your advice was auto-compacted to keep our context small and deliver better results.