You can toggle between YouTube and Spotify as the default playback provider.

Note that you do need to be a premium Spotify user for it to work. That's not needed for YouTube, so that explains why YouTube is the default.