Panipat, Haryana, India
Results-Driven Data Engineer with 5 years of experience designing, building, and optimizing scalable data solutions across diverse industries. Snowflake Advanced Data Engineer specializing in modern data stacks, including Snowflake, dbt, SQL, Python, and cloud platforms (GCP/AWS). Proven expertise in ETL/ELT pipelines (Nexla, Airflow), data modeling, and warehousing to deliver high-performance analytics and actionable insights. Passionate about transforming raw data into strategic assets while ensuring efficiency, reliability, and scalability.
- Migrated Snowflake stored procedures to Airflow DAGs, developing custom Airflow hooks (extending BaseHook) to ingest data from iLevel and Monday boards. Enabled efficient handling of incremental and full loads, reducing runtime by ~50%.
- Client-facing role with both technical and business knowledge and skills to manage, architect and develop end to end data pipelines to fetch data from multiple sources and load it into snowflake. - Built data pipeline using stored procs on snowflake by utilizing Snowflake API Integration and scheduled the same using Tasks and designed a robust monitoring and alerting mechanism to handle task failures effectively. - Loaded CDC data from Mysql server to Snowflake and also implemented SCD Type 2. - Designed fact and dimension models in dbt following industry best practices and implemented scheduled jobs to refresh them on a daily basis. - Conducted root cause analysis (RCA) for client-reported issues and delivered documented solutions to address and prevent recurrence. - Designed and developed Task Monitoring Dashboard in Streamlit on Snowflake to create, monitor and alter the tasks in Snowflake. - Gain an in-depth knowledge and understanding of client's data sources, business model, and analysis objectives. - Interpret and translate client business requirements into technical specifications for design. - Communicate confidently and pro-actively with customers throughout the project life-cycle. - Manage customer expectations appropriately and keep projects on schedule and within scope - Worked on the development of Database Migration Assistant to migrate on-premise MySQL DB to Snowflake by decreasing the overhead time by more than 70%.