logoalt Hacker News

natrystoday at 6:03 PM5 repliesview on HN

Some official benchmark numbers posted in Chinese social media (I am sure they will publish an English blogpost later too):

https://mp.weixin.qq.com/s/V4xhEIy8xDXSMDPrPkmUAQ

Generally looks like a Sol/Fable tier model, better across the board than Opus 4.8.

(Edit) English blogpost is up now: https://www.kimi.com/blog/kimi-k3


Replies

GodelNumberingtoday at 6:34 PM

The link has 6 well-known benchmarks where this beats Fable (out of 14 I counted). If the numbers hold up scrutiny, this is scary good.

Forget about their pricing but the companies that do have means to host such models fully on-prem are also the same companies that are paying tens of millions of $ in inference cost every month, and are by extension the biggest customers of OAI and Anthropic

show 2 replies
tgtweaktoday at 7:00 PM

I think given how much benchmaxxing we're seeing - the anecdotal evidence of how competent this model is (and efficient) will depend on user's actual real-world use cases.

Given the pricing, it suggests that this model is much more efficient/competent than previous-gen OS/distilled models.

zarzavattoday at 6:22 PM

It's like reading Anthropic's obituary.

show 4 replies
scrolloptoday at 8:10 PM

Meh, not fable/sol tier:

https://www.youtube.com/watch?v=LSlV206xPqM

show 1 reply
vonneumannstantoday at 7:45 PM

Crazy how their models always come out after the US labs and just lag the performance of top models. Almost like they are performing distillation attacks... how strange.

show 4 replies