How can I set the current working directory for docker exec with an internal bash shell?

From API 1.35+ you can use the -w (--workdir) option:

docker exec -w /my/dir container_name command

https://docs.docker.com/engine/reference/commandline/exec/