logoalt Hacker News

ghm2180 • today at 3:58 PM • 0 replies • view on HN

I assume you run a benchmark on all the tasks on every change the model recommends? Do you have it set up like nanogpt speed run thingy that karpathy for a thumbs up or down for every change when you did this with astra?