I’m not sure if you have already solved it. I had the same issue.
It’s because AWS S3 is looking for that folder (projects) to serve from, which you don’t have.
Simply point Error document to index.html.
This worked for me. You can handle error pages in react-router.