alt Hacker Newswhy wouldn't they benchmark the accuracy against jev too?
Replies
sass1caia • today at 9:10 PM
They say they are only benchmarking public models in the blog.
Also, section 2.3: https://typesafe.ai/legal/mca
➕ show 1 reply
why wouldn't they benchmark the accuracy against jev too?
They say they are only benchmarking public models in the blog.
Also, section 2.3: https://typesafe.ai/legal/mca
Interestingly, I've seen better performance and similar cost to whats on JevBench