logoalt Hacker News

apwheeletoday at 12:52 PM1 replyview on HN

I think this is a good meta-lesson for Kaggle. When you have objective metrics to hill-climb towards, AI can do quite well. When you just phone it in and rely on LLM as a Judge, the results are not so great.


Replies

softwaredougtoday at 1:39 PM

It's also a meta-lesson about Kaggle.

Kaggle winning solutions rarely make sustainable engineering solutions for teams. Maximizing just model performance against an objective is a small part of the bigger picture.