alt Hacker NewsThat usually ends up being a poor use of LLMs, and is an unsolved problem with LLMs.
RAG was supposed to be the way out on that, and ended up being mostly abandoned.
That usually ends up being a poor use of LLMs, and is an unsolved problem with LLMs.
RAG was supposed to be the way out on that, and ended up being mostly abandoned.
That doesn't make much sense to me because this is in nature much like how harnesses operate: launch a bunch of exploratory subagents to search and retrieve evidence to use in the actual prompt. Think of it as caching this end result so you don't have to re-fetch in the codebase.