Is it possible to serve multiple Jekyll sites locally?

You can also start the server with an additional argument --port 1234 or --host hostname. For example:

$ jekyll serve --port 4001 --host my_hostname_or_ip

You can view all the possible CLI flags from The official Jekyll documentation