It comes up anywhere that youre working with data that has some sort of correlation structure.

In image processing, the SVD makes it possible to talk about all the rich spatial correlations in the image, and pick out the strongest ones and discard noise.

This is also why it's so ubiquitous in compression algorithms, and of central importance in stuff like quantum information.