https://www.europeana.eu/en indexes 60 million museum objects in Europe, although that includes objects that aren't artworks.

(I suspect The Last Museum is using the same open data exports.)