I somehow find it better to give 2 frontier model companies 100-200/month than dropping 10 grand on a hardware that will get old in no time with bad TPS. I really want to have a fully local model but seems like one more generation wait and we will be there?
You just described why the datacenter business is hard and as a corollary why space datacenters will not be economically viable.
Lots of people use the Mac Mini to run the frontier models over night or while traveling. I have a rack in my basement and have thought about throwing one in. You can get a cheaper machine but Apple feels a little more, “rack and forget,” if you have less price sensitivity.
Mac Mini + MacBook Neo w/ ssh can be a better setup than MacBook Pro for many people.
You could spend 100 a month leasing one of these for three years and get the best of both worlds