FYI the GitHub URL is 404ing

I’ve been integrating benchmarks into OrcaBot either locally on the app or online at orcabot.com. Mostly as a way of giving an easy way to verify my own posted benchmarks. There is a template for running SlopCodeBench. Working on a TTS one next.

Wasn’t sure if there would be a lot of interest in this space. It can be costly but some provided such as OpenAI let you hammer their subscription with these.

Source available: https://github.com/Hyper-Int/OrcaBot