Graphite kinda does that automatically with its "gt modify" command. However it keeps the history internally in your PR, but that history doesn't end up in your main branch. Once you merge the PR it looks like a single commit in the main branch history (or a single commit per PR in the stack).

It is a bit unfortunate but when using Graphite it is usually better to completely avoid any raw git commands that modify history at all.