Thoughts on a M5 Ultra 768GB if it drops? What's the price to make it worth it for you over a spark cluster?
I'm wanting to run Kimi 2.6/2.7 GGUF on it and just slap it in the server rack, but trying to decide if a spark cluster makes more sense.
The M3 with 512GB is currently sitting at around 30K, used. You can extrapolate from there.
The M3 with 512GB is currently sitting at around 30K, used. You can extrapolate from there.