I think you're right, it's counterintuitive but less competition means less rewards to share for those who keep mining. Though transaction fees / hour shouldn't decrease, maybe your share of that is bigger.