Inno Setup installer icon does not show in Control Panel or Settings

Solution is:

Add

[Setup]
UninstallDisplayIcon={app}\{#MyAppExeName}

Specifying the actual ico file did not work, but this entry did.

I tested against Windows 8/8.1. Windows 7 works without this line.