logoalt Hacker News

g42gregoryyesterday at 7:09 PM0 repliesview on HN

Ok, I just read the announcement word by word. There is a neaural accelerator in each GPU core. So presumably 64 vs 80 neural accelerators, with corresponding inference performance difference. It will make a difference for pre-fill.