Washington DC-Baltimore Area
I design, build, and maintain large-scale data-driven software systems using the latest distributed technologies. My experience spans the full spectrum of backend engineering: microservices, real-time streaming, big data computation, dimensional analytics, data storage design, information security, and cloud infrastructure. I strive to create resilient and reliable systems that are correct, maintainable, secure, and performant right from the start.
- Modernizing two very large scale and globally-deployed distributed cloud applications for email archiving, each consisting of Kubernetes microservices, big data streaming pipelines, cloud storage, relational databases, and search index clusters - Analyzing and refactoring legacy subsystems implemented in many different languages - Leading the design and development of major features and new subsystems - Influencing the overall technical direction of our products, including cross-cutting concerns - Investigating complex operational issues, particularly those inherent in distributed systems Clojure, Scala, Java, Go, Python, Perl, SQL, Spark, Polars, Spice AI, DuckDB, Postgres, Elasticsearch, RabbitMQ, Kafka, Cassandra, Redis, Docker, Kubernetes, Crossplane, Helm, Terraform, Databricks, Delta Lake, GitHub Actions, AWS (AmazonMQ, CloudWatch, DynamoDB, EC2, ECR, EKS, EMR, Firehose, IAM, Kinesis, KMS, RDS, S3, Secrets Manager, SNS, SQS, SSM), New Relic, Claude, GPT, Linux
- Spearheaded Wealthsimple's real-time fintech platform on Kafka and supported its adoption across the organization - Led the establishment of schema-first best practices and infrastructure-as-code tooling in tandem with the Development Tools team - Led the Queues and Streams architecture working group to enumerate use cases, evaluate technologies, and build consensus on a path forward - Contributed to the design and development of a real-time general ledger ingestion pipeline for financial transactions as a member of the Book of Record team Kotlin (Kafka Streams, Spring Boot), Python, SQL, Oracle, Postgres, Confluent Cloud (Kafka, Schema Registry, Kafka Connect, Cluster Linking), AWS (EC2, Kinesis, S3, SNS, SQS), Docker, Datadog, Linux
- Led data engineering and marketing technology for Walmart Labs Canada - Architected marketing applications spanning Walmart, GCP, and Azure clouds - Designed machine learning, reporting, and ETL pipelines in Spark for audience segmentation, targeting, and sales attribution - Worked closely with data scientists on ML models for control audiences and sales lift - Worked closely with Walmart's global CDP team on identifier graphs and PII - Worked closely with Google to integrate Google Marketing Platform services - Initiated, scoped, and led a multi-team migration to the public cloud, including data security classification with the Walmart Privacy Office - Helped build the nascent Walmart Labs Canada organization and its culture with engineering leadership in Toronto and Sunnyvale, CA - 1st place team member, Walmart Canada Codeception Hackathon 2019 Scala, Python, SQL, Spark, Hadoop (HDFS, Hive), Jupyter, MySQL, Solr, Kafka, Cassandra, Druid, Docker, Kubernetes, Walmart Cloud, GCP, Azure, ELK, Linux
Askuity offers a business intelligence cloud platform that provides retail data ETL, warehousing, reporting, and visualization. Askuity was a startup acquired by The Home Depot in 2018. - Led backend and data engineering - Extensive design and development of batch reporting pipelines using Spark - Developed a high-performance time series rollup data store in Erlang - Implemented pooled microservices in Scala, Erlang, and Elixir - Refactored and migrated our Amazon S3 data lake for Athena/Presto - Extensive data modeling to facilitate business analytics - Contributed to complex retail ETL pipelines with exposure to EDI - Scripted CI/CD pipelines for blue-green and rolling deployment - Developed and maintained the iOS app for 4+ years Scala (Lift, Play, Akka, Scalaz), Spark, SQL, Erlang/OTP, Elixir, Objective-C, iOS, Postgres, Elasticsearch, Riak, Docker, Ansible, AWS (Athena, CloudFormation, CloudWatch, CodeDeploy, Cognito, DynamoDB, EC2, EMR, Glue, IAM, Lambda, RDS, Redshift, Route 53, S3, VPC), ELK, Linux
Thumble was a mobile social media platform that offered users real-world rewards for creative photos. It was accepted into Toronto Metropolitan University’s DMZ startup incubator program in late 2012 and launched in early 2013. - Developed the native iOS Thumble app where photo retrieval performance was paramount and many custom UI elements with complex behaviors were required - Architected and developed an Instagram-like backend consisting of Django, Postgres, S3 photo storage, and Redis for feeds and caching - Directly influenced product direction and strategy through multiple pivots Objective-C, iOS, Python, Django, SQL, Postgres, Redis, Heroku, AWS (IAM, S3)