> Most people aren't entirely convinced that AI will ever be "too valuable" in the first place.
There will be a generational leap that makes current LLMs obsolete in every way. Let's say China gets there first, why would the CCP let it be released publicly? That is an insanely valuable advantage in everything from war fighting to economics and more.
Humans for millennia have used technological advances to make better weapons. AI will be no different, unfortunately. Wars will be fought with drones and artificial intelligence from now on.
You're making an assumption that's debatable, but let's just assume it's correct. The reality is that China won't be the only to achieve such. In the same way that the US put arguably the best minds in the world towards developing the atom bomb, and within a few years the Soviets had theirs as well. Shortly thereafter they were popping up all over Europe. It's kind of the story of LLMs in general - once people saw it was genuinely possible, we went from one LLM company to them showing up everywhere.
It's highly improbable that any country retains a meaningfully persistent technological lead, and the soft power to be gained from providing models cheaply for society will probably greatly outweigh any sort of temporary strategic advantage that 'hoarding' could provide. And the reality is that nuclear weapons remain the kings of war, by an overwhelmingly wide margin. If the US and China or Russia got into a "real" war, that's pretty much the end of the world.
> Let's say China gets there first, why would the CCP let it be released publicly? That is an insanely valuable advantage in everything from war fighting to economics and more.
Because China is based in a completely different set of values than the USA. They look at the world differently, and have a different understanding of it.
Your assumption that your attitude is pure human nature is deeply grounded in your culture, which (assuming you are from the USA) is deeply grounded in personal competition rather than co-operation. All that rugged individualism. Other cultures are less based around that, and don't see the world as a zero-sum competition for survival.
I'm no expert in Chinese culture, but there are folks from China on this topic who could probably answer this from their perspective.