alt Hacker NewsDid you experiment with giving agent better tools to navigate and document the codebase? Asts, language servers and so on?
A million tokens (not cached) sounds like a lot.
Did you experiment with giving agent better tools to navigate and document the codebase? Asts, language servers and so on?
A million tokens (not cached) sounds like a lot.
The target codebase is very large. A million tokens is a drop in the proverbial bucket.
I still don't understand how caching helps me very much. I must be misunderstanding it because I thought the user's prompt (which is the biggest variable) necessarily sits prior to all of these token intensive tool calls. How can we cache the reading of codebase if the prefix is always moving?