How do I compile openSSL in 32 bit mode on a 64bit system?

The tumbleweed badge reminded me to come back and answer it myself!
The way I got this to work was to use:

setarch i386 ./config -m32