Cmd-W closes the current *document*. In tabbed apps, the document is the tab.

It is true that Finder is always running, you can’t quit it or kill it.