How do I get the list of all the versions of a package?

You just need to add the --all to the end of your request.
You can also add -v for verbose output.

Choco list packagename --all