What is more interesting is how they went extinct.

I would assume there were local populations that lived for a long time. But then they were gone too.

Some DNA is in modern humans, so there must have been some inter-breeding, but that in itself alone can not explain why the Neanderthals went extinct.