Australia
Cloud Platforms: Extensive experience with Microsoft Azure (Synapse, Data Factory, Databricks, Power BI, Data Lake Gen2, Microsoft Fabric) and AWS (Glue, S3, Lambda, DynamoDB, Athena). ETL & Data Engineering: Designed and implemented high-performance ETL pipelines using PySpark, Scala, Python, T-SQL, and Spark SQL, boosting scalability and fault tolerance. Data Modeling: Engineered robust data models, leveraging dimensional modeling, schema design best practices, and SCD Type 2 techniques for precise historical data tracking. Performance Optimization: Fine-tuned Spark clusters, optimized distributed workloads, and implemented metadata-driven pipelines to significantly reduce processing times. Security & Governance: Enhanced data security with role-based access controls and streamlined data governance across Azure AI & Automation: Developed AI-driven workflows using Microsoft AI Copilot Studio, OpenAPI, NLP, and retrieval-augmented generation (RAG) to improve decision-making and automate processes. DevOps & Agile: Proficient in CI/CD, GitHub version control, and Agile/DevOps methodologies to ensure efficient and reliable deployment cycles.