How can I cleanly remove Workspaces in Visual Studio Code?

You can use the command palette:

Menu: View > Command Palette… (or F1)

Search: “Workspaces: Remove Folder from Workspace…” and select the folder you want to remove.

Hope this may help you