logoalt Hacker News

kraakf06today at 1:23 AM1 replyview on HN

False positives like this are probably more damaging than the guardrails themselves. If engineers can't predict when a model will switch behavior, it becomes difficult to trust it in production workflows.


Replies

catlifeonmarstoday at 3:33 AM

> “trust it in production workflows”

What degree of predictability is required? I imagine the bar is pretty low if you trust the previous models in the same contexts.