alt Hacker NewsYes, but still, what about users looking for NPU support. What happened to Microsoft's copilot+ PC campaign? (the NPU hardware, not the logo key and ad campaign) AMD's XDNA2 NPU is best supported by ONNX, I think Qualcomm Hexagon is too. The best consumer unified architectures are Apple, AMD ai+ and Qualcomm Snapdragon X Elite, even intel has an NPU offering.
Replies
NPUs you can find in AMD high-end CPUs are closer to specialized DSPs (basically big VLIW/SIMD vector units).
People love doing heavy math stuff with them (https://destevez.net/2026/05/getting-peak-tops-on-a-ryzen-ai... - not my blog)
There are plenty of smaller less powerful open weights models if all you have to run it on is an NPU.
This is a much larger more powerful model, so running it locally will not be for everyone, but you can still run it via a hosting service such as Fireworks AI.
Copilot+ PC is such a terrible and wasteful marketing effort that Microsoft has given it up.
NPUs are not inherently useless, but definitely so the way they are forced onto users machines.
NPUs are meant for tiny, tiny models that can run basically at all times but cannot affect battery life (e.g. translation, live-video cleanup, filesearch etc.), not for big LLMs. This is about 500 times to large for a NPU.