How do I turn the beep slash bell off in cygwin?

Add set bell-style none to .inputrc in your home directory. You need to start a new shell for this to take effect; that may be why your test didn’t work.