A physical paperclip collects things that aren't otherwise connected. For example, I receive a printed paper several pages long all stapled together, and I want to add a small note before passing along or returning, then I'd probably use a paperclip to attach my small note to the document. I don't think a paperclip icon in any way communicates "this will be a new window/tab when clicked."
not even "here is a completely new page clipped to this one"? :)
just double-checked, i've also used a chain icon a few times, thinking "chain link" -> link