logoalt Hacker News

bscphiltoday at 1:55 PM1 replyview on HN

Because the point of the test is to see what the agentic swarm approach is capable of. If your test assumes that a version of the thing you are trying to build is available in the training data, or can't determine if it matters whether the thing you're building is in the training data, then it's not a very useful test. Most of the time when you consider agentic approaches, you're not trying to rebuild something the agents involved are trained on.


Replies

NitpickLawyertoday at 2:22 PM

I see, that makes sense. Thank you.