Big Data using Hadoop, Hive, PIG, Sqoop, Hbase, Oozie and Map Reduce Programming
Hands on experience on major components of Hadoop Ecosystem like HDFS , HIVE , PIG, Oozie, Sqoop, Map Reduce and YARN.
Experience in analyzing data using HiveQL, PIG Latin, and custom Map Reduce programs in Java
Worked on importing and exporting data from different databases like Oracle, MySql into HDFS and Hive using Sqoop.
Experience in collecting and storing stream data like log data in HDFS using Flume and Kafka
Written Hive and PIG queries for data analysis to meet the business requirements.
Good work experience in NoSql database like Hbase
Involved in creating tables, partitioning, bucketing of table and creating UDFs in Hive
Involved in writing data transformations, data cleansing using PIG operations
Good knowledge of Spark Transformation and Actions.
Experience in integrating Hive with HBase.
Experience in importing and exporting data using Sqoop from HDFS to Relational Database
Having knowledge on using Oozie to define and schedule the jobs.