Find the module in the sysfs tree. In this case it was in
/sys/bus/usb-serial/drivers/cp2101
In this directory, there is a new_id file entry that can be used to dynamically add VID PID pair like this :
echo VID PID >new_id
Here is a LWN entry about this feature