logoalt Hacker News

uchatoday at 8:59 AM4 repliesview on HN

That's not how LLMs work. If you're talking about number of parameters, you wouldn't be able to reduce the size much by "removing" support for other languages.


Replies

k__today at 9:39 AM

Yeah, I'd assume it's possible to extract all languages as steering vectors from a model and then substract the ones you don't need from its weights.

However, that would just change the weights values and not their dimensions.

whagetoday at 10:35 AM

Can you please explain why?

show 3 replies