:delm[arks]! Delete all marks for the current buffer, but not marks
A-Z or 0-9.
{not in Vi}
'A - 'Zuppercase marks, also called file marks, valid between files'0 - '9numbered marks set from.viminfofile.
To delete them:
:delmarks A-Z0-9
Note: ~/.viminfo contains histories and marks, if you don’t want them any more, you can delete this file. Vim will recreate it next time.
So, you can do this to clear all marks:
:delm! | delm A-Z0-9