logoalt Hacker News

elxr • yesterday at 7:52 PM • 4 replies • view on HN

Run your own evals then if you have this much of a need to "correctly" choose. That'll make it clear.

I'll just stick to mostly Sol on low/medium/high and start experimenting with Terra tomorrow onward to see what it does noticeably better than Luna/Deepseek flash.

Any pareto frontier model, especially from the leading labs is guarnateed to be good enough for whatever your expectations are at this point. A quick few day test should be enough for anyone to make their own conclusions.


Replies

margalabargala • yesterday at 10:50 PM

Right, having products so poorly described that a customer needs to run their own evals to choose well is exactly what is being complained about.

solyin • yesterday at 8:50 PM

Or I'm going to give up and not use any. Consumers aren't perfectly rational. This isn't like toothpaste, where, despite being overwhelmed at the store, I still need to brush my teeth so ahhhhhh fuckit and just pick a toothpaste out of the 30 available. The alternative is I keep using Google search and think AI is stupid. Or just use Facebook's thing.

➕ show 1 reply
nailer • yesterday at 8:04 PM

> > But does Terra 6.1 beat Sol 6?

> Run your own evals then if you have this much of a need to "correctly" choose.

No. OpenAI want my money, it's on them to communicate properly.

➕ show 2 replies