Student Reviews
( 5 Of 5 )
1 review
Video of Spark with Scala Course - #3 Data types, exploring and inferring the schema in Spark course by Philipp Brunenberg channel, video No. 4 free certified online
Apache Spark with Scala Course: From Beginner to Pro
Spark Rockstar Academy: https://academy.philipp-brunenberg.de
Spark Rockstar Newsletter: https://newsletter.philipp-brunenberg.de
Entire playlist: https://www.youtube.com/playlist?listPLeEh_6coH9EpIwsiNiDCW0V-UjNZElF0d
Next video: https://youtu.be/jQBYL_zpbhs
In this video, we'll explore the schema of a DataFrame, the available data types and how the schema can be inferred during loading of a csv file.
00:00 Intro & Outline
00:29 Printing the schema
01:48 Exploring data types in SparkSQL
03:52 Inferring the schema during csv load
05:52 Outro & Conclusion