That was the convention on many older computing platforms.

A "Backspace" key on a typewriter did not actually delete: It merely moved the typing position back one space.