If the folder is the top level of a git repository, and you actually want to completely remove the entire git repo associated with the folder, then simply delete the (hidden) .git directory from the folder:
cd foldername
rm -r .git
If the folder is a subdirectory of a git repository, then gautier’s method is the one you want:
git rm --cached -r foldername/