Stellenbosch, Western Cape, South Africa
*Insert AI slop here*
I worked with PostgreSQL and Pentaho Data Integration (PDI) to map out and optimize the ETL process. I ensured that every attribute in the data warehouse could be traced back to its source, documenting each transformation step to improve data lineage transparency. This streamlined error and redundancy detection, and enhanced the efficiency and reliability of the ETL pipeline. My work contributed to better data integrity, making it easier to identify and resolve discrepancies while optimizing overall ETL performance.
Machine learning project. the aim of the project was to develop/leverage a classification algorithm in AWS sagemaker to classify Bill Of Materials levels for retail data.