What is pig and sqoop?

Reshwanth S

7y1.1kDatabases & DBA

what is pig and sqoop in big data? uses of it?

3 Replies

Know the answer? Post it — somebody with the same question will find it here.

Sagar Lad5y ago
Hi Reshwanth,

Apache Pig is a tool for analytics which is used to
analyze data stored in HDFS. Apache Sqoop is a tool to importing structured data from RDBMS to HDFS or exporting data from HDFS to RDBMS.

+1
Mukesh Sagar7y ago
Apache Pig

The Apache Pig is a platform for managing large sets of data which consists of high-level programming to analyze the data. Pig also consists of the infrastructure to evaluate the programs. The advantages of Pig programming is that it can easily handle parallel processes for managing very large amounts of data. The programming on this platform is basically done using the textual language Pig Latin.

Pig Latin comes with the following features:
Simple programming: it is easy to code, execute and manage
Better optimization: system can automatically optimize the execution
Extensive nature: it can be used to achieve highly specific processing tasks
Pig can be used for following purposes:
ETL data pipeline
Research on raw data
Iterative processing.
Apache Sqoop:
Apache Sqoop is a tool that is extensively used to transfer large amounts of data from Hadoop to the relational database servers and vice-versa. Sqoop can be used to import the various types of data from Oracle, MySQL and such other databases.
+2
Sanwar Ranwa7y ago
Hello

Check these LINKS

https://intellipaat.com/tutorial/big-data-and-hadoop-tutorial/introduction-to-pig-sqoop-and-hive/

https://prismoskills.appspot.com/lessons/System_Design_and_Big_Data/Chapter_01_-_Hadoop.jsp

https://www.quora.com/What-is-the-difference-between-Pig-and-Sqoop-in-Hadoop
+2