Richa Gupta

Senior Data Engineer/MLOps Engineer @BT Group

Solihull, England, United Kingdom

About

A tech professional with around 14 years experience in IT industry enthusiastic about data. I am Certified as Google Cloud Professional Data Engineer , Cloud Digital Leader and Professional Scrum Master. Currently working as a senior data engineer in the Consumer domain for Digital Data and AI Team. I have experience in data pipeline development using Apache Beam, Python and Google Cloud Platform components like dataflow , cloud functions, and using orchestration services like composer and workflow. I have applied DevOps principles in my work focussing on CI/CD using Gitlab and semantic release, using Terraform for Infrastructure as a code (IaC), automated testing, monitoring, logging and alerting. I have experience in collecting metrics from various services in GCP for monitoring purposes. Setting up dashboards to display these metrics and configure alerts for ops. Working to design solutions for batch and near real-time requirements to be used by Decisioning and Marketing Systems. Working to map various data points, design and develop solutions to ingest data from various sources, transform and load data into data products ensuring data governance and data quality for downstream use case. Working in GCP cost optimization project to identify and implement strategies to reduce cloud expenses. I have been responsible for safe and swift delivery of IT change and data solutions through Monthly and Continuous release pipelines using appropriate governance and controls. Have strong analytical skills , extensive knowledge on agile methodology, strong interpersonal and influencing skills whilst having clear understanding of customer needs and proven record of successful deliveries. Have extensive experience in end to end implementation of a project- starting from gathering requirements, mapping of business processes to align with Oracle functionality, developing high level and low level design, development, testing and implementation to post-implementation checks. Extensive skills in SQL and worked as PL/SQL Developer, Ab Initio Developer and Solution Architect. I always look to enhance existing processes, never settling for the status quo and drive your strategy with enthusiasm and determination. Core Qualifications: Methodology: Agile/Scrum,Waterfall, DevOps, CI/CD Project Management: Jira, Microsoft Planner, Confluence Programming Language: PL/SQL, Python, Unix, Shell Scripting, Terraform Tools: Oracle Warehouse Builder, Ab Initio, Informatica, Toad, Digital.ai Release, Cloud, GCP, GITHub, GitLab

Experience

  • Data Engineer at BT
    Nov 2021 - Present · 4 yrs 9 mos

    Currently working to design and implement data engineering solutions for the consumer domain. Working to design solutions for batch and near real-time requirements to be used by Consent use cases, Decisions and Marketing Systems. This includes identifying requisite data points, designing and developing solutions to ingest data from various sources, cleansing data, transforming and loading data into data products ensuring data governance and data quality for downstream use cases. I develop batch and real-time data pipelines using Apache Beam, Python, and Google Cloud Platform components, including Cloud Functions, Dataflow, Pub/Sub and orchestration services like Composer, and workflows. I am proficient in applying DevOps principles in my work focussing on CI/CD using Gitlab and semantic release, using Terraform for Infrastructure as a code (IaC), automated testing, monitoring, logging and alerting. This includes building generic gitlab templates which could be reused to deploy code in various environments and various projects. I have experience in collecting metrics from various Google Cloud Platform services for monitoring purposes. Setting up dashboards to visually represent key metrics, system health and data staleness. Also, configure alerts and notifications to reduce manual efforts and improve mean time to recover. I am actively involved in GCP cost optimization projects, implementing strategies to reduce cloud expenses by 1 Million Pounds.

  • Tata Consultancy Services (11 yrs 8 mos)
    • Senior Release and Data Engineer
      Aug 2017 - Nov 2021 · 4 yrs 4 mos

      • Supporting safe and swift delivery of IT change and data solutions through Monthly and Continuous release pipelines across multiple platforms using appropriate governance and controls. • Contribute to the use of release orchestration tools (digital.ai Release) and maturing Continuous Delivery practices. • Having extensive knowledge in ETL tools and processes facilitating complex data solutions delivery. • Participate in release and deployment transformation activities driving efficiency and value. • Deep understanding of technical delivery and dependencies amongst multiple applications. • Having innovative mindset to streamline release process by identifying and removing waste thus improving productivity.

    • Senior Technical Lead
      Jun 2016 - Jul 2017 · 1 yr 2 mos

      • Requirement gathering, analysis and estimation for data migration and decommissioning projects • Design high level solution and review with all stakeholders. • Guiding team members in low level design and code development to facilitate migration. • Code review followed by show and tell session with stakeholders. • Managing and responsible for the safe and swift delivery of application code in production. • Strong interpersonal and communication skills having a clear understanding of internal and external customer needs.

    • Technical Lead
      Sep 2013 - May 2016 · 2 yrs 9 mos

      • Managing project as Team Lead and help the team members to overcome the challenges they are facing. • Involved in requirement gathering and analysis, solution design and review with all stakeholders. • Developing code using ETL tools (Oracle Warehouse Builder, Ab Initio, PL/SQL) and unit testing the codes. • Managing the deployment of codes into production followed by post implementation checks. • Leading and managing team to meet the deadlines of delivery while ensuring 100% SLA meet. • Maintaining positive relation with all the stakeholders and supporting healthy work environment.