I got this working.. believe it or not by adding a single LF at the end of your private key file. E.G
-----BEGIN OPENSSH PRIVATE KEY-----
KEY
-----END OPENSSH PRIVATE KEY-----
Without the LF the private key worked fine with putty, secureCRT, WinSCP, GIT etc… but Windows (which is used by VisualCode) Kept giving me “invalid Format”