logoalt Hacker News

adrian_b • yesterday at 11:58 AM • 1 reply • view on HN

Even if you cannot know what is in an open-weights LLM, so it may include malicious content, it is still infinitely safer to run yourself an open-weights LLM, regardless who made it, when you can control as finely as you want its actions and you can customize token probability sampling, than to subscribe to an LLM as a service provided by an external company.


Replies

utilize1808 • yesterday at 12:40 PM

Easier said than done. Manipulating sampling probability is almost certainly detrimental to model performance.