Make it easy for these companies by passing a law that any AI model a company offers to the public (non-government) has to be released as open weights.
This is how we deflate the bubble safely and completely, without having to introduce a government regulator that is likely to go either too far or not far enough.
This resolves the coordination problem among these potentially good actors.
What? This is a terrible policy. In addition to the obvious AI safety risks, this just amounts to a free R&D subsidy to Amazon for hosting models. It would remove any incentive to do any R&D without AWS level physical infrastructure.
If Astra is open-weight, black hats can download it, remove guardrails, and go on an automated hacking spree.