Cuda is a moat for traditional data science, where you have a torch model and you want to easily run it on a GPU. CUDA is the happy path for doing this.
Nvidia's moat for LLMs isn't Cuda, it's installed capacity, arrangements with frontier labs, TSMC bandwith, and just the fact that it currently has no real competition.
And deals with memory manufacturers.