You can use Akhil’s solution proposed in
https://www.mail-archive.com/user@spark.apache.org/msg29010.html.
I have used by myself and it works.
Akhil Das Mon, 25 May 2015 08:20:40 -0700
Try this way:object Holder extends Serializable { @transient lazy val log = Logger.getLogger(getClass.getName) } val someRdd = spark.parallelize(List(1, 2, 3)).foreach { element => Holder.log.info(element) }