The big difference you're not looking at is the memory bandwidth. The M5 Pro has nearly twice the one of the M6:
170GB/s memory bandwidth Configurable up to 32GB unified memory
307GB/s memory bandwidth Configurable up to 64GB unified memory
That is also the factor you want to take into account for AI inference, of course.
you're looking at the wrong device.
- Apple M5 Ultra chip
- 30-core CPU with 10 super cores and 20 performance cores
- 64-core GPU
- Neural Accelerators
- Hardware-accelerated ray tracing
- 32-core Neural Engine
- 1.2TB/s memory bandwidth
one point 2 terrabyte a second memory bandwidth....
512gb coming later this year
but at the cost of a small car
Both are still very low for AI btw.