logoalt Hacker News

jerryharriyesterday at 8:00 PM0 repliesview on HN

Be careful of attention collapse. Details in a large governance file can get "forgotten" by the llm. It'll be extremely apologetic when you discover it's failed to follow some guardrails you specified, but it can still happen.