How do I automatically keep all locally installed Chocolatey packages up to date?

Try choco upgrade all -y (or cup all -y). One can create a scheduled task to run in the evenings that would do this.