Node.js v17 moved to OpenSSL v3.0.
You could try switching to v16, or set ENV NODE_OPTIONS="--openssl-legacy-provider" in your Dockerfile, or update your start script in package.json to use react-scripts --openssl-legacy-provider start (or similar depending on your specific start script).
There is an issue you can follow here: https://github.com/facebook/create-react-app/issues/11708