logoalt Hacker News

sathish316 • today at 4:58 PM • 1 reply • view on HN

Bitter lesson - anything that can be optimised outside the model or harness will be optimised by the model or harness in the next 2 months.

After trying any such pattern or skill or next big thing, I keep returning to Peter Steinberger’s advice in 2 weeks and follow “Just talk to it” engineering - https://steipete.me/posts/just-talk-to-it


Replies

jerrygenser • today at 5:26 PM

Yes, but people trying new harness improvements like superpowers and this one generate training data which then gets reinforcement learned. It needs to be bootstrapped somehow. If you are an early adopter there's not much to lose by experimenting with harness tweaks.