Spark with Scala Course - #10 What is Spark?

Apache Spark with Scala Course: From Beginner to Pro
Spark Rockstar Academy: https://academy.philipp-brunenberg.de
Spark Rockstar Newsletter: https://newsletter.philipp-brunenberg.de
Entire playlist: https://www.youtube.com/playlist?listPLeEh_6coH9EpIwsiNiDCW0V-UjNZElF0d
Next video: https://youtu.be/REQe3gaLVI8
In this video, we will explore what Spark actually is: A distributed processing engine, which is widely used to process data in file-based data lakes. Therefore, it implements many concepts to parallelize the processing of data.
00:00 Intro & Outline
00:52 A distributed processing engine
02:05 A processing engine for data lakes
03:18 Master-slave architecture
04:11 High-level architecture: Driver and worker
06:22 The driver
07:15 Conclusion