I had the same problem, and it was because the workers could not communicate with the driver.
You need to set spark.driver.port (and open said port on your driver), spark.driver.host and spark.driver.bindAddress in your spark-submit from the driver.