Fair enough, there's definitely a shortage, but there is capacity available for people that are willing to buy it. There are platforms that give easy access to GPUs for small players, while the large players can make direct contract with neoclouds or datacenter providers.
The companies discussed in the article are 493 of the biggest companies in US, so if there was value to be extracted from using bare metal + open-weight models, I am sure they would be all over it.
Everyone talks about how sophisticated those large players have become in trimming their AI spend, they're a lot more cost-conscious. Perhaps this narrative might be overblown or there is truth to it. We'll see.
alt Hacker News
Fair enough, there's definitely a shortage, but there is capacity available for people that are willing to buy it. There are platforms that give easy access to GPUs for small players, while the large players can make direct contract with neoclouds or datacenter providers.
The companies discussed in the article are 493 of the biggest companies in US, so if there was value to be extracted from using bare metal + open-weight models, I am sure they would be all over it.
Everyone talks about how sophisticated those large players have become in trimming their AI spend, they're a lot more cost-conscious. Perhaps this narrative might be overblown or there is truth to it. We'll see.