logoalt Hacker News

glouwbug • yesterday at 9:13 PM • 4 replies • view on HN

We have this same point made every release. I wonder if models actually are getting better or if these companies are just secretly hamstringing the previous models before releasing a similarly performing model


Replies

WillPostForFood • yesterday at 9:42 PM

Models are actually getting better.

becquerel • yesterday at 10:12 PM

Try using a model from a year ago.

➕ show 1 reply
taneq • yesterday at 9:49 PM

I think it takes a while to start finding the weak points in a model. It seems fantastic until you use it enough to find out that it hallucinates APIs, or can’t count letters, or uses too many em-dashes, etc. you don’t really know someone (or something) until you’ve lived with them (or it).

➕ show 1 reply
KerrAvon • yesterday at 10:40 PM

While IME 4.7 and 4.8 were not appreciably better than 4.6, Opus 5 was noticeably better, and Opus 5.5 is significantly better than Opus 5.