Data Engineer

Role: Data Engineer (5–7 years of experience)

Key Skills: Confluent Kafka and Databricks

Location/Domain Requirement: Candidates must be based in the UAE and have banking domain experience.

Role Overvie

wWe are seeking a highly skilled and motivated Data Engineer with 5–7 years of experienc

eto design, build, and optimize scalable data pipelines and platforms. The ideal candidate wil

lhave strong expertise in SQL, Databricks, Confluent (Kafka), Azure Data Factory (ADF), an

dAzure Data Lake Storage (ADLS), with a solid understanding of banking domain processe

sand regulatory considerations. This role involves working closely with cross-functiona

lteams to enable data-driven decision-making across critical banking functions

.

Key Responsibiliti

es Design, develop, and maintain robust, scalable data pipelines using Azure Data Facto

ry(ADF) and Databric

ks Implement batch and real-time data ingestion frameworks leveraging Confluent Kaf

ka Build and optimize data models, transformations, and ETL/ELT pipelines using SQL a

ndSpa

rk Develop and manage data storage solutions in Azure Data Lake Storage (ADL

S) Ensure high data quality, integrity, and governance standar

ds Support data integration across systems including core banking and C

RM Optimize performance of large-scale datase

ts Collaborate with stakeholders to translate requirements into solutio

ns Ensure compliance with banking regulations and data priva

cy Troubleshoot production issu

es

Required Skills & Experie

nce Strong expertise in SQL (complex queries, tuning, modeli

ng) Hands-on experience with Databricks, Spark, PySp

ark Experience with Confluent Kafka and event-driven architect

ure Experience with Azure Data Factory (A

DF) Experience with Azure Data Lake Storage (AD

LS) Understanding of data warehousing conce

pts Familiarity with CI/CD and DevOps for data platfo

rms

Domain Knowledge (Prefer

red) Experience in banking or financial serv

ices Understanding of core banking sys

tems Knowledge of payments, lending, wealth manage

ment Awareness of regulatory frameworks (KYC,

AML)

Soft S

kills Strong analytical and problem-solving s

kills Excellent communication and stakeholder engag

ement Ability to work in fast-paced environ

ments Strong ownership and collaboration mi

ndset

Qualific

ations Bachelor’s or Master’s degree in relevant

field Azure/Data engineering certifications pre

ferred