Read a csv-file | Philipp Brunenberg

Autoplay
Autocomplete

Previous Lesson Complete and Continue

Mastering Spark SQL with Python

Introduction

Welcome! (1:49)
What is Spark? (5:08)
High-level architecture (2:47)
Understanding the Spark SQL API (4:38)

Getting Started

Development setup (6:06)
Our first Spark application (4:52)
Read a csv-file (7:26)
The header-option (2:18)
Inferring the schema (3:08)
Data types (1:31)

Working with Columns

Referencing columns (4:59)
Exploring the API reference (4:31)
The Column class (2:56)
Assignment 1: Implement a loader (6:12)
Exploring SQL functions (2:43)
Using SQL functions in our code (5:28)
Working with SQL expressions (6:55)

Working with multiple rows

Sorting a DataFrame (6:35)
Grouping data & aggregations (10:52)
Exploring window functions (3:08)
Working with windows (1) (7:32)
Working with windows (2) (7:08)

Working with missing data

Creating a DataFrame programmatically (6:07)
Working with missing data (10:08)

Working with multiple DataFrames

Joins (1) (9:57)
Joins (2) (6:08)
Union (4:49)

Advanced transformations

Working with UDFs (user-defined functions) (1) (12:07)
Working with UDFs (user-defined functions) (2) (4:47)

Teach online with

Read a csv-file

Lesson content locked

If you're already enrolled, you'll need to login.

Enroll in Course to Unlock