Huh? 3DFX "won" initially because the Glide API was simple, lightweight and fast, but the open market pressures of gaming hardware, consumers and developers made OGL (that was "bloated" initially) and D3D (that was improved) win.
Like Glide, CUDA took off because getting started is so much easier than getting started with OpenCL,etc, so a ton of researches could do stupid prototypes without getting bogged down in implementation details and once those prototypes took off a ton of code was tied to Cuda (seriously, look at OpenCL vs Cuda hello world or simple 1d kernel examples).
Now with higher level Python bindings being popular and US export restrictions, people has put effort into stuff like PyTorch supporting other API's, because there is enough industry pressure to have alternatives, the question is how long the CUDA moat can keep giving NVidia a hardware premium.
So, CUDA really wasn't anything they embraced or extended (even if they did so with GL,etc), it's their own API thus GP's parallell to 3dfx/Glide and the question is how long they can keep milking that moat (especially, since iroincally, AI's probably makes porting to other frameworks far easier).
CUDA took off for that reason, early mover advantage.
CUDA stayed relevant because they stood behind it and supported it for 20 years rather than changing to a new framework every few years and only half-heartedly supporting, and because it worked on consumer cards so anyone could learn how to use it.