logoalt Hacker News

Bolwinyesterday at 4:52 PM1 replyview on HN

I don't think you know what distill means


Replies

airstraferyesterday at 5:26 PM

I guess I don't. Does post-training from another (larger) model not fall under the umbrella of distillation? I'd imagine it leads to the same spiky-ness issues...?

show 1 reply