GitHub was only modifying the description of the PR itself, not the commit messages for the commits included in the PR.