Skip to main content

Spark Overview for Scala Analytics LightBend

Enrollment in this course is by invitation only

About This Course

The “Spark Overview for Scala Analytics” course will cover the history of Spark and how it came to be, how to build applications with Spark, establish an understanding of RDDs and DataFrames, and other advanced Spark topics. Apache Spark™ is a fast and general engine for large-scale data processing, with built-in modules for streaming, SQL, machine learning and graph processing. Having finished this class, a student would be prepared to leverage the core RDD and DataFrame APIs to perform analytics on datasets.

This course is meant to be an overview of Spark and its associated ecosystem.
There are 5 modules to this course.
1. What is Spark
2. Introduction to RDDs
3. Introduction to DataFrames
4. Advanced Spark Topics
5. Introduction to Spark MLlib


1. Experience with Java (preferred), Python, or another object oriented language
2. No previous Spark knowledge is required
3. No previous experience with Data Science concepts is required. These concepts will be explained as needed

Course Staff

Jamie Allen

Jamie Allen

Jamie has worked in consulting since 1994, with top firms including Price Waterhouse and Chariot Solutions. He has a long track record of working closely with clients to build high­ quality, mission critical systems that scale to meet the needs of their businesses, and has worked in myriad industries including automotive, retail, pharmaceuticals, telecommunications and more. Jamie has been coding in Scala and actor based systems since 2009, and is the author of "Effective Akka" book from O'Reilly.

Frequently Asked Questions

What web browser should I use?

The Open edX platform works best with current versions of Chrome, Firefox or Safari, or with Internet Explorer version 9 and above.

See our list of supported browsers for the most up-to-date information.

  1. Course Number

  2. Classes Start

    Anytime, Self-Paced
  3. Estimated Effort