Most individual people don't want to pay for inference hardware at all. They want an affordable graphics card for gaming. While a lot of people are interested in local inference, there are many more who aren't so they are not at all a majority.

Concentrating the relevant compute resource in DCs makes sense, but to companies seeking to sell AI services, not people overall.