This is what private trackers do, but you end up with ego moderators and weird trust issues.