Is it possible to specify a different ssh port when using rsync?

Your command line should look like this:

rsync -rvz -e 'ssh -p 2222' --progress ./dir user@host:/path

this works fine – I use it all the time without needing any new firewall rules – just note the SSH command itself is enclosed in quotes.