Curitiba, Paraná, Brazil
Eletronics Engineer from Universidade Tecnológica Federal do Paraná (UTFPR). Data Engineer specialized in Databricks.
- Migration of legacy data platforms to Databricks, designing scalable architectures for high-volume workloads. Worked mainly with the translation of SQL queries to the new platform, leveraging Databrick's best features. - Manage and support Databricks workspaces for large, multi-team environments, ensuring governance, reliability and cost efficiency. - Develop and optimize ETL pipelines using Python, Spark and SQL, improving performance and maintainability. - Implement best practices around Delta Lake, Unity Catalog, CI/CD, and workflow orchestration.
- Designed, built and maintained dozens of ETL pipelines in Databricks, with Spark, SQL and Python. - Improved performance, scalability and reliability through pipeline refactoring and cluster configuration tuning. - Reduced data storage costs through strategic S3 tiering and resource management. - Built internal Python libraries and utilities adopted across engineering teams. - Ensured governance and consistency using Delta Lake and Unity Catalog.
Using exploratory data analysis, statistical analysis, and AI to find solutions and develop tools within the testing department of Volvo Trucks. Working daily with big volumes of trucks sensors' data to solve real-world problems. -Python (Pandas, Numpy, ScikitLearn, TensorFlow, Plotly) -Spark (PySpark) -PowerBI -SQL -Azure
Development and management of products that help other companies in finding value in their data. Data cleaning and analysis, data visualization for commercial insights, development of diverse solutions with machine-learning. -Python (Scikit-Learn, Pandas, Numpy) -PowerBI -SQL -Google Cloud Platform