Pune Division, Maharashtra, India
As a Data Engineer, my passion lies in transforming raw data into actionable intelligence that empowers organizations to make data-driven decisions. I have hands-on experience in the Microsoft Azure ecosystem leveraging Azure Data Services (ADF, ADLS Gen2, ADB, and more) to build scalable, secure, and high-performance data pipelines. I am focused on continuous learning and adopting industry best practices in Data Engineering.
In my role as a Data Engineer, I designed and built end-to-end data pipelines using ADF, Databricks (PySpark, SQL),Data Modelling and ADLS Gen2. I was responsible for ingesting data from multiple sources, performing data cleaning, transformations, and applying business rules in Databricks and storing the results in Delta tables for reporting and analytics. I also implemented optimizations like incremental loads, partitioning, and Delta Lake features to improve performance and reliability. Along with this, I collaborated with business and data teams to ensure data quality and was actively involved in monitoring and troubleshooting pipelines.