Lahore, Punjab, Pakistan
Senior Data Engineer with 6+ years building enterprise-grade data platforms that turn raw data into reliable, governed, analytics-ready products. I help B2B SaaS, healthcare, and fintech teams ship faster with cloud-native lakehouse, streaming, and CDC pipelines that hold up at scale. What I do: → Design and build lakehouse platforms on Databricks, Snowflake, and Delta Lake using Medallion architecture (Bronze, Silver, Gold) → Engineer real-time streaming and CDC pipelines with Apache Kafka, Spark Structured Streaming, and Debezium → Architect cost-optimized warehouses on Snowflake, Redshift, BigQuery, and ClickHouse → Build modular ELT with Airflow, dbt, PySpark, and Terraform-managed infrastructure as code → Deliver HIPAA-compliant healthcare data pipelines using HL7 FHIR R4, X12 EDI claims, and EHR integrations Recent impact: - Reduced analytics query latency 60% and storage cost 30% on a multi-tenant Databricks lakehouse - Cut Spark job runtimes 40-70% through partitioning, broadcast joins, AQE, and Z-ordering - Built sub-second ClickHouse analytics serving billions of rows for customer-facing dashboards - Delivered HIPAA-compliant clinical data warehouse ingesting HL7 v2 and FHIR R4 from multiple EHRs Tech I work with daily: Cloud: AWS (S3, EMR, Glue, Redshift, Lambda, Kinesis, MSK, HealthLake), Azure (ADF, Synapse, ADLS, Databricks, Health Data Services), GCP (BigQuery, Dataflow, Pub/Sub) Platforms: Snowflake, Databricks, Delta Lake, Apache Iceberg, ClickHouse, Redshift, BigQuery Processing: Spark, PySpark, Kafka, Flink, Airflow, dbt, Debezium Languages: Python, SQL, Scala, Bash Governance: Unity Catalog, Lake Formation, Great Expectations, HIPAA, GDPR, SOC 2 Healthcare: HL7 FHIR R4, X12 EDI (837/835/270/271), OMOP CDM, Epic, Cerner integration I'm currently open to Senior Data Engineer, Lead Data Engineer, Data Platform Engineer, and Data Architect roles — full-time remote or hybrid. If you're scaling a data platform, modernizing legacy ETL, or building a healthcare data product, let's talk. Email: [email protected]
Designing and operating enterprise-scale cloud data platforms for B2B clients across healthcare, fintech, and SaaS from architecture to production. - Architected lakehouse on Databricks and Snowflake with Delta Lake and Medallion architecture, cutting query latency 60% and storage cost 30% - Engineered Kafka + Spark Structured Streaming + Debezium CDC pipelines for near real-time OLTP-to-analytics sync - Delivered HIPAA-compliant healthcare pipelines integrating HL7 v2 and FHIR R4 from EHRs, plus X12 EDI claims processing for payer analytics - Implemented ClickHouse real-time analytics layer serving sub-second aggregations on billions of rows - Established governance with Unity Catalog and Lake Formation: PHI tokenization, column-level masking, RBAC, lineage aligned to HIPAA, GDPR, SOC 2 - Mentored junior engineers and led architecture reviews Tech: Databricks · Snowflake · Delta Lake · Spark · Kafka · Airflow · dbt · ClickHouse · Python · AWS · Azure · Terraform · Unity Catalog · HL7 FHIR · X12 EDI
I migrated from legacy hive metastore to unity catalog in Databricks.
Python, SQL, Normalization, Data Modeling, Git/GitHub, Docker