>> pretty much every manufacturer decided the trade offs are not worth the benefit.

Isn't worth the benefit for who? the manufacturers? sure.

Let's say a single manufacturer decides to offer some phones with a changeable battery, invests in their marketing, and they start becoming very popular. What happens next? Every manufacturer does the same, nobody earn a premium, total sales volume gets cut in half.