os.remove requires a file path, and raises OSError if path is a directory.
Try os.rmdir(folder+'New Folder')
Which will:
Remove (delete) the directory path. Only works when the directory is empty, otherwise, OSError is raised.
Making paths is also safer using os.path.join:
os.path.join("c:\\", "temp", "new folder")