If you want the masses to run locally, try squeezing the memory requirements down even more. 8GB of system RAM is not uncommon IRL, I suspect.

Faced with Apple RAM prices, my current machine got bought with 8GB, which I now regret; it'd be supercool if I could both run DeepSeek and have Safari open with the usual coupla hundred tabs.