Most likely, the “problem” you’re seeing is that you can’t delete anything that was not typed during your current insert mode session. This is due to the default setting for the ‘backspace’ option. Adding set backspace=indent,eol,start to your ~/.vimrc is the behavior that you probably want.