India
Worked as a ETL(DataStage) developer in the starting of my career and then switch the technology to SAP MDM later.From last 2 years working on Hadoop technology.In my first Hadoop project (Fraud Detection Analysis) I worked mainly on Hive,Pig,Impala and sqoop and Currently working on one of the US client project in which I am working on Hive,Pig,Impala,Scripting and Python.
Having 4+ year of experience in Hadoop,DWH and SAP MDM.
• Create shell script for automation purpose. • Load the data from HDFS to hive tables in the parquet format. • Also developed some pig script to remove the unwanted columns from the data. • Also do some POC for the future purpose. • Since this project was started from scratch ,I am responsible for interacting with business within the organization for the development of different rules. • Development of all the hive queries required for developing the rules for fraud detection. • Transferring of the output from Hive to mysql using sqoop. • Automation of queries using shell scripting to run on scheduled basis. • Generate the Jasper report for reporting purpose.