logoalt Hacker News

kimjune01today at 7:23 AM0 repliesview on HN

Although Arena is adversarial and resistant to goodharting, it's not immune. Models that train on Arena converge on helpfulness, not necessarily truthiness