I had this exact problem. I believe it was caused by my default umask, which caused some of the Docker files to be installed with incorrect permissions. I was able to fix it by correcting the file permissions the docker key file:
sudo chmod a+r /usr/share/keyrings/docker-archive-keyring.gpg