logoalt Hacker News

cube00 • today at 12:03 PM • 8 replies • view on HN

The way Anthropic continues to get away with testing these nerfing "experiments" on customers without their consent depriving them of the model quality they've paid for is wrong.

The Windows Insider program has shown plenty of people will willingly sign up to be testers for a taste of the rawhide. Anthropic could do this in a transparent way but they continue to choose not too.


Replies

roncesvalles • today at 2:19 PM

They can get away with it because they are so far ahead of OpenAI models for coding, it's not like you can switch to anything else if you don't like it. Astra is even worse than nerfed 5.5.

Pretty much the only alternative is loading up some credits and using Fable.

➕ show 4 replies
WarmWash • today at 3:21 PM

If you aren't pay per token, then they can do whatever they want.

A bit like "You can order the steak for $75, or you can have whatever the chef is making for $30"

lp92 • today at 1:24 PM

Probably won't work for Anthropic because they likely want a larger assortment of users and use cases.

➕ show 1 reply
Tostino • today at 12:46 PM

They'd probably claim "well, it's not an A/B test then, because we are pre selecting for a specific user type who signs up for this".

I don't think that's an excuse, but it is likely the reasoning.

richardlblair • today at 2:17 PM

Oh brother, do I have news for you...

boxed • today at 1:45 PM

You would prefer they experiment on everyone at the same time without a control group? Think about your answer.

➕ show 1 reply
bothers • today at 3:18 PM

[dead]