This is called the minimap, and, as stated in that link,

If you would like to disable minimap, you can set "editor.minimap.enabled": false in your user or workspace settings.

Once you save the settings file, the minimap will be gone.