Student Reviews
( 5 Of 5 )
1 review
Video of Spark with Scala Course - #9 Assignment I in Spark course by Philipp Brunenberg channel, video No. 10 free certified online
Apache Spark with Scala Course: From Beginner to Pro
Spark Rockstar Academy: https://academy.philipp-brunenberg.de
Spark Rockstar Newsletter: https://newsletter.philipp-brunenberg.de
Entire playlist: https://www.youtube.com/playlist?listPLeEh_6coH9EpIwsiNiDCW0V-UjNZElF0d
Next video: https://youtu.be/KT0pkhAXDBw
We'll plug everything we learned together and will implement a small use-case using the Spark SQL API. We'll rename columns to be of lower camel case, add a new column and filter our DataFrame.
00:00 Intro & Outline
01:22 Renaming columns to lower camel case
05:48 Renaming columns using a function
07:51 Adding a new transformed column
10:25 Filter the DataFrame
12:01 Conclusion & Outro