Autoplay
Autocomplete
Previous Lesson
Complete and Continue
Mastering Spark SQL with Python
Introduction
Welcome! (1:49)
What is Spark? (5:08)
High-level architecture (2:47)
Understanding the Spark SQL API (4:38)
Getting Started
Development setup (6:06)
Our first Spark application (4:52)
Read a csv-file (7:26)
The header-option (2:18)
Inferring the schema (3:08)
Data types (1:31)
Working with Columns
Referencing columns (4:59)
Exploring the API reference (4:31)
The Column class (2:56)
Assignment 1: Implement a loader (6:12)
Exploring SQL functions (2:43)
Using SQL functions in our code (5:28)
Working with SQL expressions (6:55)
Working with multiple rows
Sorting a DataFrame (6:35)
Grouping data & aggregations (10:52)
Exploring window functions (3:08)
Working with windows (1) (7:32)
Working with windows (2) (7:08)
Working with missing data
Creating a DataFrame programmatically (6:07)
Working with missing data (10:08)
Working with multiple DataFrames
Joins (1) (9:57)
Joins (2) (6:08)
Union (4:49)
Advanced transformations
Working with UDFs (user-defined functions) (1) (12:07)
Working with UDFs (user-defined functions) (2) (4:47)
Teach online with
Our first Spark application
Complete and Continue
