I think most of the people who use the term in the context of Linux desktops don't know the term's origin (or at least don't stop to think about it), so the possibility of it being racist never occurs to them.