Use in Visual Studio Code (Vim extension) CAPS instead of ESC

Late answer, but may be useful for someone:

Switched CAPS and ESC in Ubuntu over the keyboard preferences section. Worked in almost all applications, but not in Visual Studio Code.

So I modified VS Code settings:

{
    "keyboard.dispatch": "keyCode"
}

and it worked.