Manohar Kethari

Senior Data Engineer | Azure, Python, and Big Data Analytics | Specialized in SQL, ETL processes, Data Warehousing, and Hadoop | Developing scalable, high-performance data processing systems

Salmiya, Hawalli, Kuwait

About

Over a decade the journey began from being core into SQL development and with growing time it strengthened multifold by gaining experience in terms of exposure which involved complex projects, large data set handling, high performance query optimisations, handling ETL JOBS, Data migrations from legacy system to Azure clouds and other high performance systems, building and managing data factories, building data models and data bricks using pyspark and Scala, followed by creation of insightful and data driven dashboards on Power BI for analytical processes and data driven business decision making across wide horizon of industries from Human Resource, Aviation Services etc hence making me an important asset to the organization for the value driven performance delivered by me.

Experience

  • Senior Data Engineer at Agility
    Sep 2022 - Present · 3 yrs 10 mos

    Design and architect data solutions on the Azure platform, including data lakes, data warehouses, and streaming analytics systems.Develop and implement ETL (Extract, Transform, Load) processes to ingest and transform data from various sources into Azure data services. Utilize Azure Data Factory, Azure Databricks, and other tools to orchestrate data pipelines and workflows.Implement data integration patterns for real-time streaming and batch processing scenarios. Build data processing and analytics solutions using Azure services such as Azure Synapse Analytics, Azure SQL Database, and Azure HDInsight. Develop data processing logic using programming languages like Python, SQL, and Spark to perform complex transformations and calculations. Implement data security measures such as encryption, access controls, and auditing to protect sensitive data. Optimize data pipelines, queries, and workflows for performance, scalability, and cost-efficiency.

  • Agility E Services Pvt Ltd (On-site)
    • Senior Analyst
      Jan 2017 - Aug 2022 · 5 yrs 8 mos

      Develop and maintain data pipelines for collecting and integrating data from various sources.Implement efficient ETL processes to ensure timely and accurate data ingestion. Optimise data processing workflows for improved efficiency and scalability.Develop predictive models and algorithms to address business challenges and opportunities. Evaluate model performance and refine algorithms to enhance accuracy and effectiveness. Utilise data visualization tools (Tableau, Power BI, SSRS) to present complex data in a clear and understandable manner.Collaborate with stakeholders to understand reporting requirements and deliver actionable insights.

    • Software Engineer
      Jan 2013 - Dec 2016 · 4 yrs

      Design and develop database solutions using Microsoft SQL Server.Create database schemas, tables, views, stored procedures, and functions to support application requirements. Optimize database structures and queries for improved performance and scalability.Develop ETL (Extract, Transform, Load) processes to integrate data from multiple sources into SQL Server databases. Schedule and automate data loading tasks to ensure timely and accurate updates to databases.Tune SQL queries, indexes, and execution plans to improve query performance. Normalize database structures to minimize redundancy and improve data integrity.Collaborate with data architects and stakeholders to design scalable and maintainable database solutions. Document troubleshooting procedures, best practices, and database configurations for knowledge sharing and reference.