Send a 404 error via htaccess?

Try:

RewriteRule ^directory/ - [L,R=404]

This redirects all requests for the folder “/directory/“, they get a 404 response.