About the Company
We are seeking a Senior Data Engineer to support the enhancement and optimisation of an enterprise data and analytics environment.
About the Role
The successful candidate will be responsible for designing, building and improving data pipelines, integrations, data models and reporting datasets while helping to improve data quality, performance, scalability and governance across the platform. Working closely with business stakeholders, analysts, architects and engineering teams, you will play a key role in modernising and supporting the organisation's data ecosystem.
Responsibilities
Data Engineering
- Design, develop and maintain scalable data pipelines.
- Build and optimise ETL/ELT processes.
- Develop and maintain data integration solutions.
- Implement data transformation and cleansing logic.
- Ensure reliable movement of data across multiple source systems.
Data Platform Optimisation
- Improve data warehouse performance and scalability.
- Optimise database queries and data processing workloads.
- Support platform monitoring, troubleshooting and performance tuning.
- Identify and resolve bottlenecks within existing data solutions.
Data Quality & Governance
- Implement data validation and quality controls.
- Support data lineage and metadata management initiatives.
- Assist with reconciliation and data accuracy processes.
- Contribute to governance and best practice standards.
Reporting & Analytics Support
- Collaborate with BI and Analytics teams.
- Support semantic models and reporting datasets.
- Improve reliability and performance of reporting solutions.
- Enable trusted data for business decision-making.
Integration Development
- Develop and maintain APIs and system integrations.
- Support real-time and batch data movement processes.
- Troubleshoot integration failures and data flow issues.
- Improve monitoring and operational visibility.
Required Skills
- Strong SQL development skills
- ETL/ELT development experience
- Data warehouse development experience
- Data modelling knowledge
- Data integration experience
- Performance optimisation and troubleshooting
- Experience working with large datasets
- Strong understanding of data quality principles
Preferred Skills
- Cloud data platform experience
- Azure Data Factory
- Databricks
- Snowflake
- Microsoft Fabric
- Synapse Analytics
- Python
- Spark
- API development/integration
- CI/CD experience