The $timeout service returns a Promise object which can be used to cancel the timeout.
// Start a timeout
var promise = $timeout(function() {}, 1000);
// Stop the pending timeout
$timeout.cancel(promise);
To cancel all pending timeouts, you need to maintain a list of promises and cancel the complete list when you open the modal.