After contacting Google Play support they replied and said that if you use analytics we need to choose YES on The AD_ID permission for an analytics use case on the Advertising ID section.
You should not remove permission manually or remove analytics sub-modules that contain AD_ID permission since it can break things…
So just need to choose YES even if the app is not using Ads.