Toronto, Ontario, Canada
I love challenges and solve problems; Solid knowledge in Azure, PySpark, SparkSQL, SQL, PLSQL, Oracle DB Technologies, MySQL Server, C#, Python.
· Participated in the migration from on-premises infrastructure to the cloud for one of the top three largest banks in Canada. · Designed and built scalable Spark/Databricks pipelines that delivered standardized, BI-ready datasets. · Developed ETL/ELT batch jobs using Databricks, PySpark, and Spark SQL. · Created tables and data models in Azure Synapse. · Developed a data quality framework that identified data issues before they propagated downstream. · Built data pipelines and a data warehouse capable of handling millions of transactions and thousands of SKUs. · Monitored data pipelines using Datadog. · Documented source-to-target mappings, including business rules, join conditions, and data transformations. · Partnered with customer engineering teams in a Scrum-based Agile environment.
- Delivered high-quality solutions through reliable code and continuous delivery for over 7000 users on the ERP Piramide; - Acted as a mix of system analyst and software engineer in a five-person team in a factory with more than 30 coworkers; - Meet face-to-face companies managers and users for gathering and analyzing requirements; - Created system solutions through data modelling and development of back-end customizations using Oriented Object Programming in C# and PLSQL. - Constructed advanced SQL queries with multi-table joins, group functions, subqueries and stored procedures for data analysis; - Had a leadership role in the construction of a new module in the ERP Piramide for four major natural gas companies acting since the conception with customers, then as team lead developer and finally within the approval process; - Contributed to a well succeed 4 colleague task-force created to reduce 95% of the bugs backlog in the ERP.