I feel like you're overstating NVidia's influence. OpenCL with AMD GPUs was also just fine around that time, we were all figuring out how much you could port and get a crazy speed up for not much effort. NVidia's ecosystem was particularly annoying to deal with on Linux. Maybe we'd have gotten AlexNet a year later without Cuda.
GPGPU computing massively predates both Cuda and OpenCL