logoalt Hacker News

slp3rlast Friday at 8:48 PM2 repliesview on HN

This feels like massive overengineering just to bypass naive chunking. Emulating a POSIX shell in TS on top of ChromaDB to do hierarchical search is going to destroy your TTFT. Every ls and grep the agent decides to run is a separate inference cycle. You're just trading RAG context-loss for severe multi-step latency


Replies

stuaxoyesterday at 12:01 AM

Could totally have FUSE over the chunks and then there is no shell emilation.

show 1 reply
MeetRickAIyesterday at 12:19 AM

[dead]