Jenkins: Failed to connect to repository

The problem was that somehow I created the ssh files with the root user.
So the files owner was root.

The solution was just change the ownership to the jenkins user.

chown jenkins id_rsa.pub 
chown jenkins id_rsa