Prior to Android 9 Pie, the persistent property is stored as a file and can be removed.
rm /data/property/persist.this.is.my.property && reboot
Since Android 9 Pie, persistent properties are stored in a single file (commit 16fad42) and can only be unset.
setprop persist.this.is.my.property \"\" && reboot