Pregraph

DataTool

Large-scale processing with Spark

Processing data that doesn't fit on one machine, with DataFrames that look a lot like pandas.

About 20 hours of study.

Where to learn it

Read
Spark quick start

Apache Software Foundation

Quick start, then the SQL and DataFrames guide

Section not checked yet

Watch
Data Engineering Zoomcamp

DataTalks.Club

Module on batch processing

Section not checked yet

Practise

No practice set picked yet.

Suggest one

Which roles ask for it

Before and after

Large-scale processing with Spark

Opens up

Nothing else on the map yet.