Why does yarn install dev dependencies but I just need the builds?

Use --production=true (or simply --production or --prod for short). It is indeed normal behaviour; Yarn assumes you are in a ‘development’ context unless your NODE_ENV environment variable is set to ‘production’.

Have a look at Yarn’s documentation.