logoalt Hacker News

duskdozer • today at 11:26 AM • 0 replies • view on HN

They need some of that fluff to keep up the illusion of intelligence and sycophancy that gets people to rely on them. Additionally, they need to make sure they don't prune so much that the model size seems manageable on consumer or standard business hardware, otherwise more people may become tempted to self-host a distilled or other semi-open model. The model size is also a marketing point.