logoalt Hacker News

yaoke259 • today at 11:13 AM • 2 replies • view on HN

Supporting Huawei Ascend 950 NPUs with open source inference code has huge implications in the global AI hardware market. Imagine if all smaller labs now can build on top of this stack and add increasing support for more compatible hardware , software and models. This could seriously challenge NVidias death grip. Although inference is still only a part of all AI workloads and open sourcing training on Huawei chips would be even bigger.


Replies

senordevnyc • today at 12:18 PM

I thought that inference was now the majority of AI workload, not training.

➕ show 1 reply
neutronicus • today at 3:19 PM

Yeah, the first place my mind went was that this is an incredible on-boarding / marketing effort for the Huawei hardware.