The counter to this is that I and many humans were trained on open source code and yet we generally think we should be allowed to create proprietary code. Though I have a friend that argues that human generated code shouldn’t be proprietary either, so I guess my counter point could go the other direction!
An LLM is not a human or anything like one, materially or in law.
The counter to that is that an LLM is not a human, and humans have special rights wrt. copyright law.
The counter to this is "let's not pretend that humans learning and LLM training are activities whose scale and nature are relatable".