logoalt Hacker News

alightsoultoday at 4:25 PM5 repliesview on HN

how is it possible to distill fable only a month after its release? maybe they are confusing opus with fable.


Replies

orbital-decaytoday at 4:31 PM

Distillation is a superficial step and doesn't need a lot of data, it's not "stealing the model" like they want everyone to believe. 99% of work is already done by that point. That said, it's pretty clear K3 has Claude's data in the training set (either Opus or Fable), as it repeats Anthropic's prompt injections. (not that it matters to anyone besides Anthropic themselves)

wongarsutoday at 4:33 PM

If by "distill" they mean "used it for fine-tuning" then they might have used it in the final stages of fine-tuning of Kimi K3. I image they might have already been using Opus, and when Fable became available it was easy to switch over to it

It would have been a tiny part of the overall training, given the timeline

sosodevtoday at 4:33 PM

A month seems plenty long enough. They're not rebuilding the entire model from scratch. It's just getting Fable to act as a teacher model for some of the final reinforcement learning on the base that Kimi already had.

show 1 reply
cmdocidjcijetoday at 4:28 PM

Create a couple thousand Claude max accounts and split the work amongst them perhaps.

show 1 reply
supriyo-biswastoday at 4:31 PM

Honestly, it wouldn't surprise me if they just found evidence of distillation once in 2025 against some Chinese AI lab, and they've been lying about the rest to create a narrative.

show 1 reply