CUDA is useful if you want a human expert writing new experimental kernels, perhaps while testing different algorithms.
But once you do that, translating CUDA into one of many available vectorized backends is trivial.
We have a bunch of custom kernels for geometric operations (like merging polygons) and they were rather difficult to write a while ago. AI rewrote them in HIP during my lunch break.