logoalt Hacker News

grogersyesterday at 3:16 AM1 replyview on HN

Well they also shadowed production traffic and fixed some bugs that were causing mismatching results. Not saying that stuff can't still slip through, but it's a good way to evaluate it against real data in a way you can't from just test cases alone


Replies

jgalt212yesterday at 11:45 AM

parallel execution that auto-generates test cases from exceptions is very slick. That being said, you still need humans in the loop as sometimes the oracle is not THE oracle.