Gurugram, Haryana, India
Microsoft Certified Data Engineer at EY GDS with 12+ years of experience in data architecture and analytics. I specialize in designing scalable, cost-effective data solutions across cloud platforms, leveraging Databricks, PySpark, Python, and SQL. As an Engineering Lead, I have led end-to-end data initiatives, driving architecture decisions, ensuring best practices in code optimization, and delivering high-performance, scalable data pipelines. With the rapid rise of AI , I focus on developing AI-ready data platforms that support advanced analytics and real-time data processing. ✔ Databricks | PySpark | Python | SQL | Delta Lake ✔ Azure (ADF, ADLS, Synapse) | Cloud Data Engineering ✔ ETL/ELT | Data Warehousing | Data Lakes | Lakehouse ✔ Performance Optimization | Code Optimization | Scalability ✔ Data Modeling (Star/Snowflake) | System Integration ✔ BI Tools (Power BI/Tableau) | Reporting & Dashboards
Description:The objective of the project was to build an end to end ABC cloud analytical landscape on Azure involving Power BI dashboards to connect to backed Azure DWH(dedicated SQL Pool) to enable a reporting data model which consolidates different enterprise data domains that helps to analyse the data from lenses of member and providers like members driving financial trends, chronic conditions and social determinants etc. Responsibilities: Assessing quality of brand data by profiling from various master data sources and identifying attributes such completeness, validity, consistency, timeliness and accuracy in ensuring the conformance of data values to business requirement and acceptance criteria. Provisioned end to end ADF pipelines for extracting data from heterogeneous source systems, transforming and loading into the warehouse independently and ensuring the proper unit testing and performance improvements. Worked with different sources and destinations such as Flat Files, Azure Blob, Table Storage,, Azure Synapse etc. Worked with Azure data bricks using pyspark for applying data quality, business logic transformation and implementing logging. Extensively worked on SQL Server Management Studio/Azure Data Studio for extracting data using T-SQL Queries, stored procedures and views using managed database services from Azure and performance tuning the long running queries. Developed Power BI reports & effective dashboards after gathering and translating end user requirements Designed reports and dashboards which analyses the data from lenses of a member and Provider like Population Demographics, Claims Financials, Provider Speciality etc. Worked on documentation and deployment of the application Designed CI/CD DevOps for Deploying ADF,Data bricks Notebook and SQL Synapse
Description: Designed an automated cloud based data warehouse which involved ingesting data from multiple On-prem SQL DB's and cloud sources reference data into azure storage account ensuring the data quality and implementing the business logic of adjustments by processing the data into warehouse tables using data factory . The landscape also involves integration of Power BI for creating reports like trial balance, Net Income and other custom user specific financial reports. Responsibilities: Addressing the existing data governance issue by profiling the various master data sources and identifying attributes such completeness, validity, consistency, timeliness and accuracy in ensuring the conformance of data values to business requirement and acceptance criteria. Developed ADF pipeline on Azure for extracting data from heterogeneous source systems, transforming and loading into the SQL Server Database Worked with different sources and destinations such as MS Excel, Flat Files, SQL Server, table storage etc. Implemented highly complex adjustments business logic within the stored Procedures ensuring high performance. Worked on parameterised, drilldown, drill through reports in Power BI related to Financial & Sales, Business Trends, Growth analysis, Expenditures, Profit /Loss, Commissions etc. Worked on documentation and deployment of the application.
Development of new functionality in the existing application. ● Enhancement of the existing database . ● Involved in ETL Testing of the new functionality. ● Extensively worked on SQL queries, subqueries, stored procedures development and enhancements. ● Responsible for deployment and monitoring of SSIS Packages. ● Created design and deployment document • Created data comparison SSIS jobs between data sources system for functional testing. • Debugging of the SSIS packages and providing the break-fix/Hot-fix for any existing code. • Resolving the various data and connections related issues. • Analyzing and providing SSRS reports on business requirement.
• Providing ETL enhancements and maintenance to the end users for more than 10 data warehousing applications. • Created data comparison SSIS jobs between data sources system for functional testing. Development of new functionality in the existing application. ● Enhancement of the existing database to as per the changed requirements. ● Involved in ETL Testing of the new functionality. ● Extensively worked on SQL queries, subqueries, stored procedures development and enhancements. ● Responsible for deployment and monitoring of SSIS Packages. ● Maintenance of the application for better end user experience. ● Created design and deployment document for the modified package • Monitoring and maintain SSIS Jobs on SQL servers in PRD, UAT, SYS. • Debugging of the SSIS packages and providing the break-fix/Hot-fix for any existing code. • Resolving the various data and connections related issues. • Analyzing and providing SSRS reports on business requirement.