alt Hacker NewsI'd assume the closed weight models are all working on shrinking their parameter counts anyways. They too benefit from smaller models. It'd be foolish for these SOTA labs to not be working at reducing parameter counts.
I'd assume the closed weight models are all working on shrinking their parameter counts anyways. They too benefit from smaller models. It'd be foolish for these SOTA labs to not be working at reducing parameter counts.
The incentive is there, but their money making niche is to solve problems you can't solve locally with a 30b, so they're unlikely to stray into territory owned by ultra cheap to run open weights models.