It’s well known scala bug: https://issues.scala-lang.org/browse/SI-7005 Map#mapValues is not serializable
We have this problem in our Spark apps, map(identity) solves the problem
rdd.groupBy(_.segment).mapValues(v => ...).map(identity)
It’s well known scala bug: https://issues.scala-lang.org/browse/SI-7005 Map#mapValues is not serializable
We have this problem in our Spark apps, map(identity) solves the problem
rdd.groupBy(_.segment).mapValues(v => ...).map(identity)