logoalt Hacker News

01100011 • today at 12:56 AM • 7 replies • view on HN

As the author mentions, the biggest threat is from customers becoming competitors. The problem space is stabilizing and this allows the biggest buyers of GPUs to work with companies like broadcom to make their own chips. Thanks to agents, they can also spin up their own abstraction layers and debug tools. CUDA is becoming less relevant, and the rate at which that is happening is about to go parabolic.

Surely Nvidia won’t stand still and will continue to compete, but the margins will collapse along with volumes.

AMD will probably suffer less, relatively speaking. Their failure to invest in software finally seems to be paying off now that LLMs can pick up their slack. But the growth currently priced in to their stock will never materialize and they’ll be seen as arriving just in time for the lights to go out.


Replies

irq-1 • today at 1:16 AM

> CUDA is becoming less relevant, and the rate at which that is happening is about to go parabolic.

CUDA is the 'open' standard that exists today, has market/mind share, and doesn't lock you into a vendor. Look at google to see how difficult it is to make a new chip and surrounding system.

Still, Nvida should work on making the generation of chips and languages that come after CUDA.

➕ show 4 replies
vannevar • today at 1:42 AM

>As the author mentions, the biggest threat is from customers becoming competitors.

Maybe in the long term. The biggest threat in the short term is Nvidia's exposure to the data center bubble, which was already showing signs of popping before Jensen's departure. Given Nvidia's role as a key investment bank in the AI trade, making and brokering circular financing deals around data centers, his departure could hasten the data center collapse if the company starts backing away from its key financing role.

wilsonjensen • today at 1:38 AM

The timing of the WH dropping this makes me suspect Kushner types angling to tank stock, make a lot of bag holders, buy it all up with Saudi or some other country's help

Dylan Ratigan went on that rant a decade ago about it being a mathematical fact American wealth was being extracted through sale of all these corps and offshoring

We are to be serfs of royalty, religious cranks, and the rest of the non-contributor orator class

➕ show 1 reply
Ygg2 • today at 3:51 AM

> the biggest threat is from customers becoming competitors.

I'd rephrase that a bit. The biggest threat was from their customers commoditizing them (while Google and Amazon could become competitiors, rest are way more iffy). You know, nVidia actually competing on price instead of relying on locking them in nVidia propietary landscape.

https://www.wsj.com/tech/ai/nvidias-days-as-an-open-checkboo...

jmyeet • today at 3:37 AM

I'm kinda surprised at how many people on this thread think you can now vibecode a GPU and compete with NVidia, basically. This is a wildly optimistic view of AI's capabilities. NVidia has several important moats and a huge lead in this space. That's not going to disappear anytime soon. It has expertise in chip design, the volume relationship with TSMC and the relationship with HBM producers.

I do agree CUDA is becoming less relevant though.

There are two companies I'd be most concerned about if I were NVidia's CEO:

1. Apple. It's huge and has a long history at this point of making very efficient chips that use a shared memory pool. This defeats NVidia's tactic of aggressive market segmentation by the amount of VRAM. You can buy a Mac Studio with 256GB of RAM (well, you have to wait until March currently) for ~$11k. That's a lot cheaper than a single RTX 6000 Pro; and

2. Google. They currently buy or rent a lot of GPU capacity from SpaceX and others as well as make their own data centers. But they also have their own TPUs that they've been developing for years. I would be shocked if they've not investing billions into ramping up that program so they can use homegrown chips for AI. Google is still the best at building their own data centers and their own networking is industry-leading (IMHO).

lumost • today at 1:15 AM

A quick prompt to ChatGPT estimates that a B300 should cost around 6-10k in a mature market given typical CPU industry/silicon economics. NVidia has a massive margin for a semi-conductor firm, it would not be surprising to learn that AI is much cheaper than we currently estimate when that margin is removed.

tayo42 • today at 1:45 AM

Why do you think custom chips means they'll stop buying GPUs not just use more of everything? That's what I saw when AMD got competitive with Intel and arm showed up.

➕ show 1 reply