Bhopal, Madhya Pradesh, India
Azure Data Engineer with nearly 3 years of experience in optimizing and developing data solutions. Skilled in improving existing code and implementing new scripts to ensure efficient data transformation and smooth workflow execution. ● Designed and deployed scalable Big Data solutions on Azure, collaborating with cross-functional teams to optimize ETL processes while ensuring data integrity, quality, and consistency. ● Analyzed Requirement Specifications and Design Documents from Unilever SMEs, including Functional Snapshots (FS), to ensure alignment with project goals and deliverables. ● Planned, developed, tested and optimized solutions using ADB (Scala, SQL, PySpark) and ADF, collaborating with clients to deliver – scalable and reusable products on time. ● Managed and implemented multiple code changes through user stories, ensuring alignment with project requirements. ● Performed major ETL/ELT transformations and seamlessly integrated these solutions with Azure Data Factory (ADF) pipelines and Databricks workflows to establish a robust, end-to-end ETL process. ● Performed comprehensive functional testing, including unit testing, data validation, schema verification, checking for duplicates and null values on primary keys, ensuring non-nullable constraints, and performing count checks between source and target to ensure data integrity. ● Served as Release SPOC, managing all release activities, including PPD loads and testing, ensuring the deployment of high-quality, bug-free code. ● Used Azure DevOps for continuous integration and deployment (CI/CD), streamlining the software development lifecycle, following Agile methodology, and using JIRA for effective project management. I am always open to networking, sharing knowledge, and exploring innovative data-driven solutions. Let’s connect and collaborate!