Looking at the source it seems that the remote feature branch is deleted only if you call git flow feature finish with -F.
However, this fetches the remote before finishing the feature. From the docs:
-F fetch from $ORIGIN before performing finish
Otherwise you can delete the remote branch manually with:
git push origin :feature/new