logoalt Hacker News

lenerdenator • yesterday at 10:14 PM • 0 replies • view on HN

I don't think it'll continue on linearly, but it will likely continue.

We're getting the Claude efficiency talks at work. We're looking at all sort of optimizations, including local models and graphify, to reduce spend. There are people dedicating their nights and weekends to dropping token consumption and cache rebuilding. A few of these will likely catch on and be brought into common use. That will relieve at least a bit of the pressure, and enable some of the scaling to continue.