Diego Menin

Senior Data Engineer at Amazon - DEIII (L6)

Barcelona, Catalonia, Spain

About

I'm an AWS Certified "Big Data - Specialty", "Solutions Architect - Professional" and "Developer - Associate" with a master’s degree in Data Science from Trinity College Dublin (first-class honors). I design and build Big Data and Machine Learning solutions in the cloud, helping customers to improve their business. I'm the guy who can sit down with business users, understand their needs and goals and architect a solution that will allow them to achieve those goals. I can then, implement that solution myself or by sharing the workload between members of a team, while keeping track of deliverables and maintaining constant communication with the shareholders.

Experience

  • Senior Data Engineer - DEIII (L6) at Amazon
    Oct 2020 - Present · 5 yrs 10 mos

    Technical lead of the Amazon's Transportation Data Engineering Team. My two main products consist of a near real time Delta Lake that holds most of the European transportation related data, built using AWS Serverless technologies, Spark and Apache Hudi / Iceber and the tool responsible to enforce GDPR rules across that lake and several other data stores.

  • Senior Data Engineer - AWS at TerraAlto Limited
    Oct 2018 - Sep 2020 · 2 yrs

    Worked on: ● Designing, building and maintaining data solutions for a variety of clients; ● Automating Data Science and Machine Learning CI\CD pipelines with Amazon SageMaker, Step Functions and other supporting AWS services; ● Implementing Data lakes with S3, GLUE, Athena, Redshift Spectrum and AWS Batch; ● Migrating Hadoop solutions to AWS with EMR (with pyspark and livy) and Airflow orchestration; ● Implementing DevOps and automation with CloudFormation, CodeCommit, CodeBuild, CodeDeploy, and CodePipeline;

  • RenaissanceRe ()
    • Risk Data Warehouse and Business Intelligence Engineer
      Feb 2014 - Sep 2017 · 3 yrs 8 mos

      ● Working mainly on building tools to allow Risk roll up, score and return period analysis and “what if” simulations.

    • Risk Data Warehouse and Business Intelligence Developer
      Nov 2012 - Jan 2014 · 1 yr 3 mos

      ● Worked as a member of the Risk Data Team to design, develop, support, and deliver projects on Data Warehouses, Data Marts, Cubes and ETL for the Underwriting and Risk teams. ● Actian Matrix \ Amazon Redshift developer on the Company's Big Data project; ● Tableau Server administrator and dashboard developer.

  • Software and Database Developer at Citco Fund Services
    Nov 2010 - Nov 2012 · 2 yrs 1 mo

    ● Designed and maintained a SQL Server data warehouse, ETL processes and Microsoft SSAS cube that provided middle management with a dynamic and centralized reporting solution. ● Analysed database objects, mainly T-SQL procedures and views, to speed execution time and reduce resource consumption. ● Developed internal applications using C# and SQL Server.

  • Software developer at Page7 Media
    Apr 2009 - Feb 2010 · 11 mos

    ● Analysed and developed a CRM system to support the sales team contacting potential customers, increasing the number of prospects reached by 400%. ● Developed a Web Crawler to browse and collect information on websites that fed the CRM. ● Developed a full suite of SSIS packages to integrate several data feeds with the main database. ● Analysed database objects, mainly T-SQL procedures and views, to tune execution time.