Spark code organization and best practices [closed]

I think you can subscribe Apache Spark, databricks channel on youtube, listen more and know more, especially for the experiences and lessons from others.

• Apache Spark
• databricks
• Spark Technology Center

here is some videos recommended:

• SparkUI Visualization

• slide SparkUI Visualization

• Spark in Production: Lessons from 100+ Production Users

• slide Spark in Production: Lessons from 100+ Production Users

• Spark Tuning for Enterprise System Administrators

• Spark Tuning for Enterprise System Administrators

• Building, Debugging, and Tuning Spark Machine Learning Pipelines – Joseph Bradley (Databricks)

• slide Building, Debugging, and Tuning Spark Machine Learning Pipelines

• Top 5 Mistakes When Writing Spark Applications

• slide Top 5 mistakes when writing Spark applications

• Tuning and Debugging Apache Spark

• slide Tuning and Debugging Apache Spark

• A Deeper Understanding of Spark Internals – Aaron Davidson (Databricks)

• slide A Deeper Understanding of Spark Internals – Aaron Davidson (Databricks)

and I’ve posted and still updating it on my github and blog:

• github post
• blog post

hope this can help you ~