Everything is either deterministic, random, or a mix of that.
New is just a mix of deterministic and random. LLMs are not deterministic.
You don't even need an LLM to create something new and improved. Evolutionary algorithms have been doing it since the 80's.