logoalt Hacker News

xmcqdpt2 • yesterday at 10:11 PM • 0 replies • view on HN

Do you have eval testing? Benchmarks? Deterministic model checkpoints? Deterministic harness versioning?

Building "orchestration" without being able to deterministically measure improvements is not engineering, it's cargo cult.