Turns out I had index.html in the wrong place. From the webpack docs:
To load your bundled files, you will need to create an index.html file
in the build folder from which static files are served (–content-base
option).
I made a copy of index.html in a new folder I called deployment to match what I specified in the output.path