"Just a few weeks ago a SOTA model was shown to reproduce non-trivial amounts of licensed code[0]."
That LLM response is describing a specific project with full attribution.
And it proves the code is stored (in a compressed form) in the model.
And it proves the code is stored (in a compressed form) in the model.