Andrew Knight

Data Engineer @ HSBC | Software Developer Consultant @ Sparta Global | BSc Computer Science from University of Warwick

London Area, United Kingdom

About

Currently consulting as a Data Engineer, where I have been able to explore and utilise a vast infrastructure of LLMs, and have also gained confidence using cloud infrastructure, ETL pipelines and data analytics. I am enthusiastic working end-to-end, my team falls within the Financial Crime sector of the bank, which has leveraged me an understanding of governance and the risks involved in the data we use, as well as the ongoing need for automation, to enhance performance and leverage our AI support. Primarily working with Python and SQL, deploying to Google Cloud Platform (GCP), running ETL pipelines with Jenkins and a Kubeflow CMLP. A further background, I am a Computer Science graduate with a robust foundation in software and web development, complemented by 6 years of diverse experience in both technical and leadership roles. Proficient in multiple programming languages, primarily Python, confident and versatile in object-oriented approaches. Proficient in front-end development, experienced using Django and React as frameworks when producing JavaScript/HTML web applications. Keen to progress in career as a developer and display social and practical skills, being involved in technological advancements and software innovations.

Experience

  • Data Engineer at HSBC
    Sep 2025 - Present · 10 mos

    As a Data Engineer, my focus is on data quality, ensuring that ensuring pipelines run successfully, new images are readily available for production, and data is ingested appropriately. Whilst gaining a holistic understanding of DevOps practices. - Utilised Python and Data Build Tools (dbt) within Kubeflow CMLP and Google Cloud architecture to process millions of transactions daily. - Developed pipelines for engineering and analytical use to support data integrity and handling of transactions. - Successfully completed several new market rollouts to the Data Quality Framework, fully integrating through pipeline execution, infrastructure building for Google Cloud platform, and data ingestion analysis. - Contributed to implementing new policy metrics that reduced capacity usage by 97% across available markets in the Dynamic Risk Assessment value stream. - Supported in analytical role, querying ingested real-time production data, ensuring governance standards are met, and identifying where technological improvements can be made to enhance the framework.

  • Software Developer Consultant at Sparta Global
    Apr 2025 - Present · 1 yr 3 mos

    Trained and deployed as a full-stack developer, working on website applications and database models, before focusing more on data engineering during consultancy with a Tier-1 Bank. - Certified using GoLang for back-end development, creating and managing databases and utilising generics. - Certified using React for front-end development, gaining confidence in JavaScript, using RESTful APIs, and ensuring integration with Docker and back-end databases.

  • Head Bartender at Jonos Free House
    Apr 2023 - Apr 2025 · 2 yrs 1 mo

    Gained proficiency working in a team environment, understanding further the mitigation of tasks and ensuring staff and customer satisfaction. Involved in staff management, maintenance, order and banking management. Social and practical advantages.

  • Warehouse Team Member at Paragon
    Jul 2021 - Dec 2021 · 6 mos

    Worked in a large team, with constant time-pressured jobs, beneficial in many ways, including learning the importance in management of workload ad-hoc, and more collaborative tasks.

  • Web Development Team Member at The National Archives, UK
    Jul 2019 - Jul 2019 · 1 mo

    As work experience, for 2-weeks I was a member of the development team for the The National Archives website. During this time I experienced how it was to operate in a team, and how to effectively communicate and disperse responsibility. I also was able to observe development in front and back-end in real-time, and the integration and feedback that comes with this.