logoalt Hacker News

ycui1986today at 1:11 AM1 replyview on HN

For many LLM load, it seems ROCm is slower than vulkan. What’s the point?


Replies

mmis1000today at 8:01 AM

Compatibility so foundation packages like torch onnx-runtime can run on AMD GPU without massive change in architecture. It's the biggest reason for those stuff that "only works on nvidia gpu". It's not faster if vulkan alternative exists, but at least it runs.