Robert Cox

Senior Data Engineer | Spark, Databricks, AWS, Azure | Ex-MD & Consultant | OSS author

Bristol, England, United Kingdom

About

The thing about problem solving: the harder it gets, the more I want it. That's why I'm still doing this thirteen years in. Across consultancy, engineering and an earlier stint as Managing Director of a SaaS company. Government, banking, payments, energy trading, anti-fraud platforms, infrastructure rollouts. Different sectors, different teams, same pattern: figure out what the problem actually is, then ship something that holds up. Attention to detail is the thing I'm known for. I notice the things that get missed. In data engineering that's most of the job: the difference between a platform that quietly works and one that quietly drifts is whether someone's actually paying attention. Stack: Databricks, Spark, Azure, AWS, Terraform, Airflow. On the side: a game leaderboard live since 2015, now at 250,000 users. And Joystick Diagrams, an open-source Python tool with 12,000 users.

Experience

  • Senior Data Engineer at KnowBe4
    Jun 2024 - Present · 2 yrs 2 mos

    Senior Data Engineer delivering real-time data solutions across Azure and AWS to combat fraudsters. Technologies: Azure and AWS stacks, Databricks, Azure Synapse, Spark, Azure Event Hub, MSK & MSK Connect, Terraform, Airflow, AWS EMR, AWS Lakeformation, Datadog

  • Creator / Python Developer at Joystick Diagrams
    Aug 2020 - Present · 6 yrs

    Novel Python software, originally built as a prototype and then transformed into an open source tool. Over 180 Github stars and ~12000+ users. https://joystick-diagrams.com

  • Software Engineer at Battle Royale Games
    Oct 2015 - Present · 10 yrs 10 mos

    Co-creator of a leaderboard system serving 250,000+ users since 2015. Originally built for PlayerUnknown's Battle Royale in Arma 3 (which became PUBG, one of the most-played games in Steam history). Featured in Canard PC magazine. Now in maintenance mode with support for Arma Reforger. Architecture: • PHP Laravel (migrated from Laravel 5 to 10 over the project's lifetime), MVC + OAuth • Frontend migrated from Blade templates to Vue.js • MySQL with full data model design, performance optimisation (indexing, partitioning, query tuning) • Linux infrastructure including networking, security, deployment tooling (Deployer) • GitHub Actions for staging/production deployment • Redis and Memcached for caching layer The project has run continuously for 10+ years.

  • Career transition at Career Break
    Nov 2023 - Jun 2024 · 8 mos

    Time with family, personal projects, and transition from consultancy into engineering-only work.

  • Senior Digital Analyst at Capgemini
    Apr 2022 - Oct 2023 · 1 yr 7 mos

    Senior Digital Analyst working in SC-cleared roles across multiple client engagements. Manager to two direct reports. • Led requirements gathering for the largest custom AWS landing zone project in Europe (£500m annual spend). Used Power BI to create a data model that enabled the client to see cross-team similarities and prioritise product development. The approach was adopted as the standard going forward. • Led development of the data model to import and validate GIS data (ESRI Shapefiles) from partner organisations against locally held PostgreSQL geospatial data, displayed in an interactive web UI for the Welsh Sustainable Farming Scheme. • Coached the programme on automated testing practices, replacing historical 100% manual regression suites and upskilling the team. • Developed a Power BI dashboard for managed-service ticket analysis, sanitising and transforming data via custom mappings and providing remediation recommendations. Stack: Power BI, PostgreSQL (PostGIS), AWS, GIS (ESRI Shapefiles), Data Modelling, Data Analysis.