logoalt Hacker News

tgluck • yesterday at 3:28 PM • 0 replies • view on HN

Not really

they distill different things. model2vec distills a sentence transformer into static embeddings, so the output is a faster general-purpose encoder.

Jevstiller keeps the encoder frozen (bge-small by default) and distills Jev's decisions on one specific question into a small head on top of it