logoalt Hacker News

HDBaseTyesterday at 10:24 PM0 repliesview on HN

"Claude Fable 5 and 5.1 are not included in LifeSciBench Gold v1, GeneBench Pro v13, and MedChemBench because they refuse the majority of questions in these evaluations.12"

Sounds about right. Alignment is important, but also being able to do mundane tasks is important too.