Staff Data Engineer
Location: Remote (Must be based in US)
Pay: $170k - $210k Base
Overview:
A high-growth technology organisation is building a cutting-edge AI-driven platform designed to power advanced analytics, machine learning, and real-time decision-making. They are looking for a Staff Data Engineer to play a key role in architecting and scaling their data infrastructure. This is a highly impactful role focused on designing modern data pipelines and enabling AI/ML capabilities at scale within a cloud-first environment
Responsibilities:
- Design, build, and scale robust data pipelines and data platforms in AWS
- Develop ETL/ELT workflows using tools such as Glue, Lambda, and EMR/Spark
- Architect and optimise data lake and warehouse solutions leveraging S3, Redshift, and Athena
- Implement real-time and batch data processing using Kafka, Kinesis, or MSK
- Collaborate with data science teams to support AI/ML model development and deployment (SageMaker)
- Build and manage orchestration workflows using Step Functions or Airflow (MWAA)
- Ensure data quality, governance, and security across systems (IAM, Lake Formation, KMS)
Must Have Qualifications:
- 7 - 10 years of experience in Data Engineering
- Strong AWS expertise including S3, Glue, Redshift, Lambda, and EMR (Spark)
- Advanced proficiency in Python and SQL
- Experience building scalable data pipelines and distributed data systems
- Strong understanding of data modelling, warehousing, and lakehouse architectures
Nice to Have:
- Experience with Kafka or AWS streaming tools (Kinesis, MSK)
- Exposure to Scala and/or Spark-based processing
- Experience with AI/ML platforms and tools such as SageMaker or Bedrock
- Familiarity with workflow orchestration tools (Step Functions, Airflow)