But now you’ve looped back around to my original point: a large context window is essential to making it work well. Those *.md files won’t do anything if you don’t feed them into the LLM at inference time.
(edit: That said i do agree with the idea of designing systems so that such a large window isn’t needed. But that seems a bit self defeating if the goal is massive development acceleration with agentic coding. These models seem to be pretty bad at engineering for simplicity. And protecting system design with close human oversight would mean we are still limited by the speed at which humans can read and understand code.)
Large enough context window is enough. Yes, the md files can be filled back in, but other stuff (unneeded details) can be swapped out.