Perhaps. I suspect it may have more to do with the idea that many non-vegans think (whether or not it is true) that vegans believe themselves superior. It isn't unlike how learning that someone is an atheist angers many religious people -- they think the atheists think that they are superior (whether or not they really do).