How do I get Vim to recognize ESC key faster?

If you are using tmux, that could be introducing a delay. Put this in your ~/.tmux.conf file:

set -s escape-time 0