You can remove the whole dialog title by calling dialog.setUndecorated(true) but this means that the dialog can’t be moved anymore.
You can also execute dialog.setDefaultCloseOperation(WindowConstants.DO_NOTHING_ON_CLOSE) to prevent that the button does anything.
Besides that, I don’t think that there’s a way to remove the X completely.