Deleting a folder in TFS is a little strange.
You have to:
-
Create a Workspace
-
Get the latest source for the folder (to your local machine)
-
Inside Source Explorer, delete the folder
-
Check in your changes (this is the step that deletes the folder in Source Control)