is everyone just waiting for teh DGX Spark? Are they really going to ban local inference?
What do you mean ban? The bandwidth between macs isn't enough to do inference effectively.
What do you mean ban? The bandwidth between macs isn't enough to do inference effectively.