Richmond, Virginia, United States
Performed big data analysis for product improvement to optimize key regional online travel agencies performance to support growth in North America and EMEA. • Provided competitive analytics and insights to improve low fare search performance and availability quality. Built and maintained interactive customer dashboards to monitor and report competitive metrics. • Provided critical customer consulting and sales support. Supported product and solution strategy, find tuning and improvement opportunities for Sabre shopping and availability products.
Analyze and define client’s strategy and determine system architecture and requirement to achieve goals. • Associated with creating Hive Tables, and loading and analyzing data using Hive Queries for reports. • Involved in converting Hive/SQL queries into Spark transformations using Spark RDD's. • Work with a variety of data formats such as JSON, Compressed CSV, Parquet etc. • Worked in AWS environment for development and deployment of custom Hadoop applications. • Strong experience in working with ELASTIC MAPREDUCE(EMR)and setting up environments on Amazon AWS EC2 instances. • Very good experience with version control. • Importing and exporting data into HDFS and HIVE using Spark and Scala. • Load and transform large sets of structured, semi structured and unstructured data. • Developed job flows to automate the workflow for the data to be loaded to AWS S3 buckets and hive. • Designed and Implemented Partitioning (Multi-level), Buckets in HIVE. • Loaded the aggregated data onto Amazon S3 Buckets from Hadoop environment for reporting on the dashboard. • Performed ETL operations such as transformations, event joins, filters both traffic and some pre-aggregations before storing the data onto cloud. • Good understanding of Partitions, Bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance. • Responsible for the design and development of high performance, robust software using Scala • Developed different kinds of reports using large amounts of data that can be integrated with the app developed. • Expertise in writing the Scala/Python code using higher order functions for the iterative algorithms in spark for performance consideration. • Implemented Spark using Scala and utilizing Data frames and Spark SQL API for faster processing of data. • Worked in utilizing spark machine learning techniques implemented in Scala and Python.