redis-server --port 6380
will start a Redis server listening to port 6380.
redis-cli -p 6380
— a suggestion made here as well — does not start a Redis server listening to port 6380, but tries to connect the CLI to a (hopefully running) Redis server that listens to that port.