Databricks Spark Knowledge Base

The contents contained here is also published in Gitbook format.

• Best Practices
  • Avoid GroupByKey
  • Don't copy all elements of a large RDD to the driver
• General Troubleshooting
  • Job aborted due to stage failure: Task not serializable:
  • Missing Dependencies in Jar Files
  • Error running start-all.sh - Connection refused
• Spark Streaming
  • ERROR OneForOneStrategy