Bengaluru, Karnataka, India
Area of interest: Big Data, Distributed Computing, Large Scale Machine learning SKILLS: Computer Languages : Java, Python, Scala Big Data Technologies :- Zookeeper, Kafka, Spark, Hadoop, Docker Data Center Management(Hands On Experience): Mesos, Kubernetes Automation: Jenkins, Ansible JVM Profiling
- Created financial data pipeline for Goibibo, which is realtime and fault tolerant with reporting tool. It automated whole financial accounting, reporting and payouts for hotel which were handled manually. Technology used: Spark, Kafka, Hbase. - Created a Persuasion data store for GoIbibo Hotels. It supports queries like how many people are looking at this hotel right now and more like this. Single store is able to serve multiple use cases with >> 10K request per second. Technology used: Apache Flink, Redis & Kafka. - Created user activity store which is having all data of user in a single place which can serve queries around user as an Entity. Goibibo Chat bot & User Personalization are being powered by this. Technology used: Spark, Kafka(Kafka Streams + Kafka Connect), DynamoDB. - Improved Flight search experience using past bookings. Reduce the number of flights on Goibibo Search Page which increased speed and enabled Goibibo mobile app for 2G customers. - SQL Shift(explained in projects category) - Designed & Implemented scalable data warehouse for GoIbibo Hotels.
Worked on Distributed Computing and Big Data Analytics. Following technologies are used for processing large data processing: - Spark (large scale data processing) - Kafka (distributed messaging system) - Zookeeper (distributed configuration management system) - Docker - Mesos (Operating system for data center) Worked on real time data processing engine demonstrating credit card fraud detection. Created Test Automation Driver for Middleware application which validates data flowing from all exposed interfaces of the system. Profiling java applications with various tools like yourkit, jmap. Responsible for setting up Continuous Integration using Jenkins for middleware and real time data processing application.