Nvidia's Risky Business

Nvidia's biggest advantage in AI has never been only their hardware performance but how entrenched their software is in ML research that flowed down stream. However, if you've actually used CUDA C/C++, it's pretty one of the worst software development ecosystem imaginable: you get all the footgun of regular C++, plus GPU compute pretending to be C++ and but doesn't actually behave like C++ because CPU and GPU compute are fundamentally different, and the only reason people put up with it is because Vulkan and HIP C/C++ are even worse.

Google's limitation is that they still don't offer TPUs in a PCI-E card/dev board that people can plug in to their PC for local development and sane low level API to develop against, instead you have to go through their cloud and their full software stack which greatly limits ecosystem growth. The minute that Google figures that out, that's when Nvidia's dominance would be challenged.

In many investment theses - like Nvidia's bet that demand for compute will keep growing - the first order assumption is usually correct. Yes, demand for more compute, chips, infrastructure is huge and each year some additional data centers will be built. Where such investment bets usually fail is in the second-order assumptions: Ie. the expectation of the growth of demand. This is where there's a high chance that the current expectations are likely exaggerated. So: demand is likely to persist for the foreseeable future but not increase every year. And that can upend the whole investment story. That can be enough to make these bonds a huge burden for Nvidia in the end. Not because people stopped buying more compute but because they stopped buying more every year.

More interesting take on Nvidia's position than I've come across before. One thing to be noted is 1) Nvidia is already making moves in robotics so even if their position in AI (moreso llms) diminished, they certainly have another big avenue arguably harder to just get into (although I'm not sure what efforts Google is doing for the tpu in robotics). Another point is Nvidia is still the main player in the west, that is, China certainly can and will create their own full stack without reliance on US companies. That puts Europe and other countries in an interesting, do you buy Nvidia because it's the only option or for security. That's to say I believe Nvidia's position relied on many different things being true at the same time, and we're moving towards an environment where those things are certainly being contested at (roughly) the same time.

For awhile I've found two things hard to square, that the hardware and software making up current gen AI will bring us to a socioeconomic singularity, and the reality the thing they're mostly trying to emulate is a few pounds of meat and fat running on tens of watts equivalent. On one hand the current AIs are obviously super human in some tasks, get completely dunked on in others by far simpler organisms. My cat can catch a bug out of the air, Fable 5 in Cowork can lack the dexterity to make a slideshow because I had LibreOffice instead of Microsoft Office. Not even close to analogous, but point being they appear to have pretty fundamental differences in how they can interface with the world that the economic thesis seems to gloss over.

Nvidia has been playing a dangerous but profitable game since the Crypto boom.

but now I think they probably have bitten more than they can chew.

Apple already proved with their unified memory - that as long you have the capacity you can run capable models locally - thereby goes demand for inference if everyone is running some model locally.

For training - Chinese models have proved that you don't need the latest & greatest in Nvidia hardware. Same as TPUs.

only time will tell.

IMO focusing on the hyperscalers is kind of misleading.

Yes, for programmers and tech companies AI is kinda boring now, but AI integration in general is still kind of uncharted territory.

There are so many small companies and individuals just getting started with AI today and I believe a large the customer base (and revenue) is still untapped. Hell, I’m discovering new use cases regularly still and the average mismanaged 30 people whatever SaaS vendor probably didn’t even get started yet.

I wonder why Google doesn't create an open-source CUDA alternative. Google released Kubernetes to stay relevant/competitive in the cloud wars, they were a distant third. They now have an opportunity to create an open source industry standard.

Or the companies spending trillions of dollars can do a Manhattan Project (Or X-Prize) and let a thousand startups work on it. One will succeed. Between Google, Amazon, FB, Microsoft, Apple, AMD, Qualcomm, Intel (and dozens of other companies) there is enough economic incentive to do it. Also, isn't this what AI is supposed to be extremely good at, CUDA experts can continue to write CUDA (without having to learn anything new), a translation layer will rewrite it. If software can be one-shot from markdown files, this can't be impossible.

I see we have reached the stock market phase of Universal Paperclips.

Tend to agree with Ben's thesis RE Demis and DeepMind not really being focused on the agentic coding race. That being said, it remains to be seen whether Sergey and Koray can inspire the foot soldiers in the same way that Sama and Dario do. I'm not too optimistic, and that's to say nothing of the fact that Google cannot possibly hope to compete with these other companies on potential employee upside.

Laughable to cite and reiterate the idea that Google is cooked where it comes to SoTA and AI in general when they operate, reliably and successfully for decades, one of the largest computing infrastructures on Earth and will likely continue to usefully serve the 90% of AI requests that don’t involve managing large codebases. Also seems strange to suggest that Google would need to Aquihire a company like Thinking Machines when it could spin up their AI model in a couple of weeks on its own TPUs if it felt like it. Demis likely wants to focus on his specific interest at the junction of biochemistry, neurobiology and computation which is more specific and unique to Demis than building a general purpose Q&A search model.

> To translate such figures into comparable 2026 magnitudes, multiply by a factor of 1,200.

Perhaps this has something to do with the economic dislocations and world wars between the 1870s and today?

There's another factor which Ben failed to consider. Which is that NVIDIA doesn't need to rely on demand for their proprietary CUDA stack or their GPUs growing -- they are already selling directly to the consumer, and likely capturing much higher margins. They are moving up stack, not down, where demand for raw compute matters less. With the DGX Spark and Jensen’s statement about “open models”, their next product is likely a strong hint: consumer devices to fulfill the Mac Mini demand craze. They are probably going to start burning LLMs durectly onto sillicon and then selling DeepSeek-in-your-home to individual developers. I bet that would sell even better than Anthropic Max coding plans and is not dependent on hyperscaler funded boom-bust cycles. So Ben’s analysis highlights the risk of their existing business not growing but they are likely planning new businesses.

Nothing goes up and to the right forever. Nothing.

Building a business model on the belief that “this time is different” always finds storms on the horizon.

People and pundits have been dooming and bearing on Nvidia for as long as it's been around. It increased in intensity when gpus were used for large scale crypto mining and it became material to their operations, and continued as AI ("the bubble") started to really take off.

Over those years, my NVDA stock has been by far my biggest winner. I'm now up more than 1500% on it.

Let the dooming continue

> The subsequent bankruptcy of Jay Cooke & Company triggered the Panic of 1873, culminating in endless railroad bankruptcies across the country, a multi-year depression, multi-decade deflation, and, one could argue, the financial conditions that made Europe, four decades later, into a tinder box.

American history education needs some dire reform.

> After the departure of DeepMind CEO Demis Hassabis (technically promoted to chairman, but no longer in charge of day-to-day operations) and Gemini co-lead and former Chief Scientist Jeff Dean, along with a host of other prominent researchers, SemiAnalysis declared that Gemini is Cooked: "For all intents and purposes, we believe DeepMind is no longer a frontier lab"

Counterpoint: xAI pooped out a frontier model based on nothing but capital and one man's desire to push a right-wing political narrative. Google has the talent, and the money, and the experience, they just need some leadership.

This is fine. everything is on fire it’s not a bubble. ;-)

Is this just an ad for a new book about trains?

Disappointed by the lack of Tom Cruise.

[flagged]

[flagged]

Ben is wrong; demand for compute, aka revenue backlogs, is mythical and will collapse, simply because of two reasons :

1. Circular investment/spending.

2. Too much capital in the system, so returns cannot be hit regardless because the barrier is too high. (Evidence being every capital cycle in history)

Ever free newsletter and talking head spouts narratives like this free. If you want something that quantifies and gives actionable information, you must do it yourself or pay for it. What are your below $2000/month sources for good analysis?

so short them. if you think that the demand for skilled-labor-substitutive capital is saturable in the medium term or that improvements at the model level eat those at the hardware/cuda level or that nvidia just has the timing wrong, short them.