Keep in mind these downloadable models use 3-10x the amount of tokens as well. You really can’t beat a couple $20 subscriptions.
https://quesma.com/benchmarks/babaisbench/
Looks like GLM 5.2 is coming in at <2x the tokens of Opus 4.8 (and 1/10 the cost)?
Great showing from Sol, though.
But also, it's Baba Is You :-D
Looks like GLM 5.2 is coming in at <2x the tokens of Opus 4.8 (and 1/10 the cost)?
Great showing from Sol, though.
But also, it's Baba Is You :-D