In case someone else comes across this, the jQuery-UI dialog does not append to the form, it appends just before </body>, so the elements to validate are outside the <form></form> section:
To resolve this, just direct the dialog to move itself inside the form when you create it, like this:
$("#mydiv").dialog("open").parent().appendTo(jQuery("form:first"));