Apple doesn't design GPUs on-par with Nvidia's efficiency yet. They need an architectural overhaul to be a serious competitor, which is what I'm expecting is queued up for M7.
Nvidia has CUDA, AMD has CDNA, and Apple has... compute shaders, I guess?
> Apple doesn't design GPUs on-par with Nvidia's efficiency yet
How much it matters in inference? Most GPUs have enough computing for that and the bottleneck is the RAM speed and size. And M5 Ultra is becoming to challenge this.
Apple has metal and mlx
Probably two generations away. I’m more interested in how much uplift/speed and more importantly what is the power usage is required for the new computers Apple is shipping particularly for the Studio versions.