Curious about your setup if you don’t mind elaborating a bit for us? What models are you using and how do you find they compare? The 128gb model costs less than one months salary for a medium level engineer here, they look quite attractive.

> whoever owns the hardware

Yes and this is why self-hosting is more important than ever. The issue with LLMs is the cost of hardware if you want something close to the frontier. But there is no excuse not to host your own files, email, media center, etc.