The issue was caused by two expired Apple certificates1.
Solution is to
- Go to Certificates, Identifiers & Profiles
- Open the provision profile
- Press
Edit
in the top right - Press
Save
without making any changes
This will regenerate the profile with the correct CAs.
Now delete the ~/Library/MobileDevice/Provisioning Profiles
folder and let xcode redownload the profiles again.