logoalt Hacker News

Betelbuddy • today at 3:13 PM • 0 replies • view on HN

Yes this is the experiment I have been running for a while, that shows the constant comments on Claude models here have to be push from Claude team friends...The experience of output of OpenAI models is consistently better.

1)- Get a coding task and get the output of Opus and Astra.

2)- Open a new session and ask each other to review in detail the solution from the other model without mentioning where is it coming from.

3)- After the review, ask the original model to comment on it and state which solution is better and if the criticisms are valid...all in a new session.

4)- At the end Opus and others from Anthropic always end up agreeing the OpenAI model solution is better. My human review agrees.

After doing this for a few weeks...and consistently having their models rating higher the OpenAI solutions...I cancelled the Anthropic subscription...