They're already kinda protected, open weight releases rarely come with datasets, especially post-training datasets. NVIDIA is probably the exception.
I also wonder when the NSA starts sharing their wiretaps/etc with labs for 'national security'. Probably already happening, to be honest.
> I also wonder when the NSA starts sharing their wiretaps/etc with labs for 'national security'.
What would this benefit the NSA? If they share wiretap records with labs such as Anthropic, then suddenly anyone who can jailbreak a model gets access to this data. You don't need to train a model on data to understand or interpret it, as far as I know - providing others (esp. AI labs) with sensitive data is a breach of security, or I am not understanding.
Wrong direction. NSA says “give us the weights to Fable and loan us some engineers who can get a TS-SCI clearance so we can train our own model in house, if you don’t well just take them, in fact maybe we already did, it’s for national security”.
NVIDIA has done great work with the open datasets and they're much appreciated, but it's worth mentioning that a large fraction of their post-training data is not released. cf. https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-1... But at leased they disclosed what wasn't released.