alt Hacker NewsYes we are (it's MIT licensed)! Feel free to email me at [email protected] or file a pull request directly on https://github.com/momentic-ai/qa-bench
Everything has to be reproducible and runnable by the general public
Yes we are (it's MIT licensed)! Feel free to email me at [email protected] or file a pull request directly on https://github.com/momentic-ai/qa-bench
Everything has to be reproducible and runnable by the general public
Thanks, that makes sense!
One suggestion for the future: QA Bench would be even more valuable with a human benchmark, so you can clearly see how the agents perform compared to human QA testers. That would settle that discussion also :)