Had the same problem, try adding option:
"git.autoRepositoryDetection": false
and close repo from your parent (home) folder. It shouldn’t appear again.
Update:
There’s now an option to watch only repositories for opened files:
"git.autoRepositoryDetection": "openEditors"
This way, if you open any file in a specific repository, vscode will only watch it.