This projects illustrate how to test Spark jobs. See the related blog posts: Testing strategy for Apache Spark jobs – Part 1 of 2 Testing strategy for Spark Streaming – Part 2 of 2 This also an example of using the spark-testing-base library.