logoalt Hacker News

svachalek • today at 6:11 PM • 0 replies • view on HN

Wow. Context management is one of the big remaining hassles with modern LLMs so this could be big. The obvious complication is cache busting so it's also exciting they investigated solutions for that.