logoalt Hacker News

lousken • today at 7:41 AM • 1 reply • view on HN

It is embarrassing how much they suck up to american labs while those models only perform the first few days after release. With open weights you can be sure the quality stays the same unlike the closed source crap. How about a retest after some time?


Replies

tsss • today at 9:18 AM

Performance depends so much on configuration parameters like KV cache that you have essentially no idea what you're getting unless you run and benchmark everything yourself, which I'm sure you do not do. If anything, hosters of open weight models are more likely to gimp it either due to incompetence or malice because they have no reputation to lose.