How can I override a constant in an imported Python module?

Yes, but it’ll only work as expected with fully qualified access paths to modules:

import example
example.examplemod.config.CONSTANT = "Better value"
example.examplemod.do_stuff()