If you see it that way, I think that you shouldn't be involved in any open source project and instead let others do it.

There are plenty of people that want to contribute in a open source project not because of the users but simply for their own need or because they believe in the project.