UPDATE: this feature is available in IDEA 11.
Not possible in IDEA at the moment, I’ve submitted a new feature request. Feel free to vote.
A workaround could be implemented using wrapper class with main() method which will redirect stdout and stderr to files and then run the main class of your application.