logoalt Hacker News

passive • yesterday at 8:00 PM • 1 reply • view on HN

I would still be interested to see metrics around the process. Overall throughput, what's the error rate, how many errors get turned into fixes, are certain types of websites less stable?

My self healing project is very experimental, so tracking and displaying these kinds of metrics are important to judging the success of the experiment.


Replies

am03 • yesterday at 9:28 PM

We're seeing about a 2.2% error rate on runs, and 82% of those errors get automatically resolved by our repair agents currently. The highest failure rates seem to come on travel and automotive marketplaces, as they tend to have more complex interfaces. By contrast we have near-zero error rates on retail.

➕ show 1 reply