Untrack and stop tracking files in git

OK, though wildcards don’t work (in Windows apparently) it seems one can remove a whole folder with:

git rm -r --cached "path/to/foo/"

I understand that –cached only unstages – you have to git commit to remove them from the repo.