logoalt Hacker News

varenctoday at 4:51 AM2 repliesview on HN

Are you worried about Google's response to this? Google reportedly reacts to distillation attempts "with real-time proactive defenses that can degrade student model performance". So if they detected you, they could have intentionally fed you a dumber but plausible variant of Gemini: https://cloud.google.com/blog/topics/threat-intelligence/dis...

But also, this model is small and just focusing on the tool use. In terms of token usage, you're probably not anywhere near the people that are trying to distill the entire model.


Replies

madducitoday at 4:59 AM

Well, it's like robbing the robbers, when it comes to training data

show 1 reply
janalsncmtoday at 8:26 AM

You could run Gemma models locally to distill them. Or any other model with tool use.

show 1 reply