If the problem was solved by anyone before or if a similar problem has been solved, then LLMs seem to be able to solve them which is an astonishing piece of technology.

I'm personally not sure if it can come with original thinking and techniques to solve completely novel problems. For that, some imagination and thinking outside the box are required, and I doubt the current architecture can do any of this.