logoalt Hacker News

dcsommeryesterday at 2:15 PM3 repliesview on HN

Sure they care about elegance, or at least brevity. Minimizing tokens out, or generally "token efficiency," is part of the objective function for these systems. It doesn't mean they are perfect at it though.


Replies

windexh8eryesterday at 3:36 PM

"They" don't "care" about anything. It is a stateless computational run across thousands of semiconductors. There is no objective this software has other than the computational function completing. To care would mean the model would have a level of discernment that goes along with sentience.

show 1 reply
Someoneyesterday at 2:30 PM

> Minimizing tokens out, or generally "token efficiency," is part of the objective function for these systems.

First time I heard that, and I doubt it. Don’t customers pay for output tokens? If so, why would a company specifically spend time training their LLM to generate fewer?

show 1 reply
senorribyesterday at 2:17 PM

You clearly haven't used Claude to generate code or documentation.

show 1 reply