You just have to stand your ground. This is true for anyone in any leadership position, whether you run an open-source project, a business, or anywhere else. Don't be a pushover.