How to set border color of certain Tkinter widgets?

Just use

widget.config(highlightbackground=COLOR)

Furthermore, if you don’t want that border at all, set the highlightthickness attribute to 0 (zero).