تقييمات الطلاب
( 5 من 5 )
١ تقييمات
فيديو شرح 9.1. Pig Introduction ضمن كورس Apache Hadoop شرح قناة CloudxLab Official، الفديو رقم 47 مجانى معتمد اونلاين
In this video, we will learn Pig.
[Pig - Introduction]
Pig is an abstraction over MapReduce. Pig is used to analyze large data by the way of data flows.
To analyze data, Pig provides a high-level language known as Pig Latin.
Pig has a component known as Pig Engine. It converts Pig Latin into MapReduce jobs.
Pig can be used with and without Hadoop. When running on Hadoop, Pig makes use of HDFS and MapReduce
[Pig - Why do we need it?]
Before Pig, programmers not proficient with Java had to struggle to work with Hadoop and to write MapReduce tasks. Pig Latin makes writing and maintaining code easier by providing many relational operations such as 'order by', 'group by' and 'Joins' which are hard to write in MapReduce.
[Pig - Use Cases]
Pig can be used for analyzing data, in Interactive processing, batch processing, and ETL - Extract, Transform and Load.
[Slide Pig - Philosophy]
- Pigs eat anything. Pig can process structured, semi-structured and unstructured data
- Pigs live anywhere. Pig can be used with or without Hadoop to analyze data.
- Pigs are domestic animals. We can control the data flow and write our own custom functions in Java and Python.
- Pigs fly. Pig is designed for performance by providing many built-in optimizations.
[Pig Latin - A Data Flow Language]
Pig scripts are written in Pig Latin. Pig Latin allows us to describe how data should flow, read, be processed and stored to multiple outputs. It also helps in writing complex workflows like performing multiple joins etc.
This Big Data Tutorial will help you learn HDFS, ZooKeeper, Hive, HBase, NoSQL, Oozie, Flume, Sqoop, Spark, Spark RDD, Spark Streaming, Kafka, SparkR, SparkSQL, MLlib, and GraphX from scratch. Everything in this course is explained with the relevant example thus you will actually know how to implement the topics that you will learn in this course.
Let us know in the comments below if you find it helpful.
In order to claim the certificate from E&ICT Academy, IIT Roorkee, visit https://bit.ly/cxlyoutube
________
Website https://www.cloudxlab.com
Facebook https://www.facebook.com/cloudxlab
Instagram https://www.instagram.com/cloudxlab
Twitter http://www.twitter.com/cloudxlab