Open Organizer in Xcode (Window -> Organizer), go to the Devices tab and select Provisioning Profiles in the left drawer. Then use the Refresh button on the bottom right.

Update 2018

From @mikeLspohn comment: Go to Window > Devices then right-click on your device and select Show Provisioning Profiles … from there you can click on +/- to add or remove profiles –