Application.Exit() not working

Well logically it cannot work. The Application cannot exit if it is not running.

It would be better to use Environment.Exit here.