Perth, Western Australia, Australia
(Working for Apple in Silicon Valley remotely) • Working for Apple in a department that is responsible for the processes from manufacturing. • Design, and development of data pipelines, data modeling, integration, quality, and governance along with security in the Snowflake platform: • Creation of data pipelines using SnowPipe to collect data from AWS S3. • Data transformation from custom semi-structured format to structured using User-defined Table Functions embedded in custom Procedures. • Query optimizations are applied given the analysis of query performance (Profile analysis). • Event-driven data capture using Snowflake stream objects. • Materialized views creation to improve performance in data visualization tools (Tableau) for data sources with large amounts of data (~1TB). • Use of SnowPark in combination with external functions for data transformation tasks. • Performance optimization of data pipelines (Python, SQL, Docker, and Airflow). • Real-time data processing having as sources structured and non-structured databases ( MySQL and GraphQL[NoSQL]). • Collaboration with various internal stakeholders from different business and technical areas to understand data requirements and provide actionable insights. • Technical leadership being in charge for deliverables during the whole project and managing the tasks efficiently. • Continuously improve data engineering processes and tools for better efficiency. • Built reliable and scalable data pipeline solutions. Data quality processes implementation. • Onboarding and mentoring of new collaborators.
Analysis of Data Warehouse systems, ETL development through Informática PowerCenter, development of Shell Scripts, and working with Teradata database. Tools: Scrum, SQL, Teradata, UNIX, SHELL SCRIPT, Informatica Power Center, (Power Center/SSIS) ibm
Elaboration of functional and technical specification, development in ABAP, and customization of features in SAP ERP. Tools: VBA, SQL Server, SCRUM.