mkdir and mkdirs return false if the directory already exists, so that might be one reason for the failure.
If you are using Java 7, you can use the Files class. It throws an IOException on error with pretty good descriptions.
Files.createDirectory(file.toPath());