alt Hacker NewsWhere are the benchmarks? Does it just speed up inference and reduce token usage or does it seem to improve accuracy on certain tasks as well?
Where are the benchmarks? Does it just speed up inference and reduce token usage or does it seem to improve accuracy on certain tasks as well?
Did you even scan the paper? There are benchmarks right there starting on the 9th page.