Yes, ROCm can be used to run frontier models and is being used by OpenAI, Anthropic, and Meta.
I would prefer direct hardware kernel interface.
Like linux DMABUFs with userland hardware command ring buffers (I guess this hardware ring buffer instance would be specific to a VMID and a PASID).
alt Hacker News
I would prefer direct hardware kernel interface.
Like linux DMABUFs with userland hardware command ring buffers (I guess this hardware ring buffer instance would be specific to a VMID and a PASID).