> who cares how many sit-ups LLMs have to do?

At large enough scale, I suspect it'll become a problem. At the moment part of the appeal is how effortlessly models absorb menial work, but I do wonder if eventually it'll be too wasteful at large scales to sustain it. Maybe not, though.