Student Reviews
( 5 Of 5 )
1 review
Video of Spark with Scala Course - #10 What is Spark? in Spark course by Philipp Brunenberg channel, video No. 11 free certified online
Apache Spark with Scala Course: From Beginner to Pro
Spark Rockstar Academy: https://academy.philipp-brunenberg.de
Spark Rockstar Newsletter: https://newsletter.philipp-brunenberg.de
Entire playlist: https://www.youtube.com/playlist?listPLeEh_6coH9EpIwsiNiDCW0V-UjNZElF0d
Next video: https://youtu.be/REQe3gaLVI8
In this video, we will explore what Spark actually is: A distributed processing engine, which is widely used to process data in file-based data lakes. Therefore, it implements many concepts to parallelize the processing of data.
00:00 Intro & Outline
00:52 A distributed processing engine
02:05 A processing engine for data lakes
03:18 Master-slave architecture
04:11 High-level architecture: Driver and worker
06:22 The driver
07:15 Conclusion