logoalt Hacker News

d_tryesterday at 6:30 PM3 repliesview on HN

How and why do they get nerfed? To save money?


Replies

johnfnyesterday at 7:28 PM

Models do not get nerfed. There has never been evidence of this. This would be trivial to prove if it were true, and such a proof would be a huge story and scandal to a news market hungry for a shred of a signal on AI's downfall.

This is the "your iPhone is listening to you and serving ads based on what you say" of the 2020s.

show 2 replies
ricardobeatyesterday at 8:48 PM

One theory is that they start serving at full precision, then quantize to save on costs as adoption grows. It's kind of a conspiracy theory atm, but I have definitely felt it - I had a large project done on Opus 4.8 release day, a week later it was struggling to complete partial tasks in the same area.

varispeedyesterday at 7:16 PM

Yes. They save on compute and customer has to use more tokens to achieve their goal which means more profit.

show 1 reply