Read it again. Two M5s.
Wait read that again. Two 512GB, unreleased model M5s.
This is gonna cost like 50k to run at home.
How much does the engineers at Meta make? Spend enough time together with others making $250k+ and eventually you start suggesting that two 512 GB M5s is something you can put on your desktop. I mean, it's one banana, Michael. What could it cost? 10 dollars?
Why would anyone want to run an LLM on Apple's hardware? Why not buy an NVIDIA GPU?
Closer to ~$30K if I had to guess. A 256 version is $11,299.00 (2TB SSD, 256GB RAM, 36-core CPU, 80‑core GPU), so yeah, 4 of those would be close to $50K but the 96->256 RAM upgrade is $4K, if we assume 512 will be double that it's ~$15K/ea.
But yes, still a massive amount of money and that's before we know the TPS or any other stats.