alt Hacker Newsyou underestimate the amount of people that use google relative to software engineers "running agents continuously for tens of hours"
you underestimate the amount of people that use google relative to software engineers "running agents continuously for tens of hours"
Maybe? But it's so many orders of magnitude apart. I can easily do 1B tokens a day (output tokens is probably like 3M?).
When I see non technical people use that Google reply I'd be surprised if it's more than 1k output tokens, and with a tiny model. So a 3000x in output tokens, on a model at least 10x as expensive, I wouldn't be surprised if hardware usage is 30.000x for a dev that uses coding subs vs someone who uses the Google AI overview a couple of times a day.
And that's not counting the absurd difference in cache reads.