logoalt Hacker News

toomuchtodoyesterday at 8:22 PM8 repliesview on HN

What can we use fields of GPUs for next?


Replies

thefounderyesterday at 8:55 PM

Whatever happened to crypto/blockchain ASICs

show 1 reply
mike_hearnyesterday at 8:40 PM

AI, obviously! A bubble doesn't mean demand vanishes overnight. There is - at current price points - much more demand than supply. That means the market can tolerate price hikes whilst keeping the accelerators busy. It seems likely that we're still just at the start of AI demand as most companies are still finding their feet with it, lots of devs still aren't using it at all, lots of business workflows that could be automated with it aren't and so on. So there is scope for raising prices a lot as the high value use cases float to the top, maybe even auctioning tokens.

Let's say tomorrow OpenAI and Anthropic have a huge down round, or whatever event people think would mark the end of the bubble. That doesn't mean suddenly nobody is using AI. It means they have to rapidly reduce burn e.g. not doing new model versions, laying off staff and reducing the comp of those that remain, hiking prices a lot, getting more serious about ads and other monetized features. They will still be selling plenty of inferencing.

In practice the action is mostly taking place out of public markets. We won't necessarily know what's happening at the most exposed companies until it's in the rear view mirror. Bubbles are a public markets phenomenon. See how "ride sharing"/taxi apps played out. Market dumping for long periods to buy market share, followed by a relatively easy transition to annual profitability without ever going public. Some investors probably got wiped along the way but we don't know who exactly or by how much.

Most likely outcome: AI bubble will deflate steadily rather than suddenly burst. Resources are diverted from training to inferencing, new features slow down, new models are weaker and more expensive than new models and the old models are turned off anyway. That sort of thing. People will call it enshittification but it'll really just be the end of aggressive dumping.

show 4 replies
narratoryesterday at 8:48 PM

Anyone who regularly tries to rent GPUs on VPS providers knows that they often sell out. This isn't a market with lots of capacity nobody needs. In the dot.com bubble there was lots of dark fiber nobody was using. In this bubble, almost every high-end GPU is being used fully by someone.

ornornoryesterday at 9:04 PM

Heating!

zozbot234yesterday at 9:22 PM

Can they run Crysis?

show 1 reply
dragontameryesterday at 8:25 PM

We can use the GPUs for research (64-bit scientific compute), 3d graphics, a few other things. We programmers will reconfigure them to something useful.

At least, the GPUs that are currently plugged in. A lot of this bullshit bubble crap is because most of those GPUs (and RAM) is sitting unplugged in a warehouse, because we don't even have enough power to turn all of them on.

So if your question is how to use a GPU... I got plenty of useful non-AI related ideas. But only if we can plug them in.

I wouldn't be surprised if many of those GPUs are just e-waste, never to turn on due to lack of power.

show 5 replies
greenchairyesterday at 8:34 PM

cloud gaming?

irishcoffeeyesterday at 8:27 PM

It’s too bad they’re all concentrated in buildings, having been hovered up by the billionaire class.

I would love to live in the world where everyone joins a pool for inference or training, and as such gets the open source weights and models for free.

We could call it: FOSS