> "delete the whole thing?"

With vi (after running "set -o vi"): <esc>kC

(k to move up back one position in history. C to "change" to the end of the line.)

This is equivalent to doing the following with "set -o emacs": <ctrl>pu

Regardless, use what you're comfortable with or can incrementally add to your muscle memory.