Correct, a rack full of datacenter equipment is not going to compete with anything that fits on your desk or lap. Well spotted.
But as a counterpoint: there are whole communities of people in this space who get significant value from models they run locally. I am one of them.
Would you mind sharing your hardware setup and use case(s)?
What do you use local models for? I'm asking generally about possible applications of these smaller models