Senior Data Engineer

Infinigate Group

London Area, United Kingdom

Description

Introduction

Infinigate Group are a leading, global distributer, specialising in total cyber security solutions and services. With 4 UK offices based in London, Woking, South Cerney and Fareham, we take pride in providing unrivalled support and value for our vendor and reseller partner communities.

Our team at Infinigate consists of IT security experts as well as highly skilled support staff. With the right people in place, our laser focus is on positive customer outcomes and long-term stable partnerships with our vendors. To deliver this objective we adopt a flat hierarchy, high performing teams, efficient decision-making processes and a nurturing and learning environment which rewards performance.

Role Purpose

Infinigate Group is seeking a Senior Data Engineer to join our innovative AI & Data team in a dynamic and fast-paced environment. This is an exciting opportunity to collaborate with a motivated team where teamwork, innovation, and personal development are core to everything we do. You’ll work with industry-leading platforms such as Databricks and Microsoft Fabric to build cutting-edge data solutions.

The successful candidate for this role will design, build, and operate scalable, high-performance data platforms that power analytics, reporting, and machine learning initiatives across the business. You will take ownership of end-to-end data pipeline architecture, from ingestion through to curated, business-ready data products, while establishing best practices for reliability, quality, governance, and cost efficiency.

We are pleased to offer this permanent position on a hybrid basis, based form any of our 4 UK offices – London, Woking, South Cerney and Fareham.

Duties & Responsibilities

  • Lead Data Pipeline architecture development/orchestration/maintenance
  • Creating robust, fit-for-purpose data modelling solutions to address multiple business cases
  • Root cause analysis and pro-active investigation to identify potential issues and optimize ETL pipelines, notify end-users and propose adequate solutions
  • Prepare documentation for further reference
  • Ensure cross functional collaboration

General Skills

Software Knowledge

  • Experience using Databricks
  • Solid SQL and Python skills – able to use the Python programming concepts in Databricks Notebooks for data loading, transformation and exploration including familiarity with Pandas
  • Strong understanding of core Databricks and Spark concepts such as Delta Live Tables, Delta Sharing, Medallion Architecture, Dataframes, Workflows, Unity Catalogue, Delta Live Tables, and UDF’s
  • Understand of databricks lakeflow connect, lakebase, metric views, genie etc
  • Understands the key principals of Data Warehouse design including Star Schema, F&D design, Dimension and Fact loading patterns, SCD and CDC concepts
  • Experience with use of MS DevOps for Scrum management and with Repos and use of CI / CD Pipelines between Azure and DevOps
  • Experience of using AI development tools such as cursor
  • Proven track record in a data engineering role where the focus has been on developing data pipelines, data warehouses, data lakehouses, and similar data repositories for BI, Reporting and Analytics use

Certifications (Nice to Have)

  • MSc Data Science or equivalent
  • Any relevant Azure certifications / exams such as: AZ-900, DP-900, DP-203, or DP-500
  • Any relevant Databricks certifications: Lakehouse Data Engineer Associate, : Lakehouse Data Engineer Professional

Personal requirements

Infinigate’s values underpin a strong collaborative working culture and successful inclusive working environment.

  • Own it! Owns the ability to quickly learn new data tools and ideas with exceptional analytical abilities
  • Aim high! Capable of analysing and troubleshooting complicated data sets hunting for a solution
  • Be open! A self-starter with outstanding interpersonal skills

Benefits

  • £70,000 - £80,000 salary per annum depending on level of experience
  • 25 days annual leave rising to 28 days with length of service, plus bank holidays.
  • Day off on your birthday.
  • 2 paid volunteer days per year
  • Additional holiday purchase scheme
  • Electric Car Lease Scheme
  • Cycle to work scheme
  • Life assurance of 4 x basic salary and group income protection from start date
  • 5% employer matched pension contributions after 3 months service.
  • Individual cover for private medical insurance and healthcare cash plan following successful completion of probationary period.
  • Hybrid working arrangements and standard office working hours are 9am – 5.30pm
  • Employee assistance programme for practical and emotional support.
  • Free parking and complimentary refreshments onsite.

Infinigate Group are committed to creating a diverse and inclusive workplace where differences are not only accepted but also valued and appreciated. If any reasonable adjustments would support you through the recruitment process, please make us aware by answering the relevant application questions. For any further queries, please contact us at [email protected].