How many Neural Accelerators does M5 Ultra has in its 64 vs 80-GPU variants?
Anybody knows?
Just to clarify, Neural Accelerators have nothing to do with Neural Engine.
Ok, I just read the announcement word by word. There is a neaural accelerator in each GPU core. So presumably 64 vs 80 neural accelerators, with corresponding inference performance difference. It will make a difference for pre-fill.
Ok, I just read the announcement word by word. There is a neaural accelerator in each GPU core. So presumably 64 vs 80 neural accelerators, with corresponding inference performance difference. It will make a difference for pre-fill.