Student Reviews
( 5 Of 5 )
1 review
Video of Spark with Scala Course - #5 Referencing Columns in Spark course by Philipp Brunenberg channel, video No. 6 free certified online
Apache Spark with Scala Course: From Beginner to Pro
Spark Rockstar Academy: https://academy.philipp-brunenberg.de
Spark Rockstar Newsletter: https://newsletter.philipp-brunenberg.de
Entire playlist: https://www.youtube.com/playlist?listPLeEh_6coH9EpIwsiNiDCW0V-UjNZElF0d
Next video: https://youtu.be/9udk6AcgrLU
In this video, we'll explore how to work with columns in the Apache Spark SQL API. Most of the time, when we work with Spark, we would like to operate (transform, select) columns. In this video, I'll introduce you how to access them.
00:00 Intro & Outline
00:36 Accessing columns using Strings
03:11 Accessing columns using the apply method
03:38 Using the col function
04:16 Using the dollar operator
05:08 Selecting columns from a DataFrame