Singapore
Passionate and results-driven professional with a proven track record in leveraging cutting-edge technologies to drive data-driven decision-making and enhance business outcomes. My expertise spans data pipelines with a focus on designing and implementing robust, reusable data pipelines. I have a solid background in data ingestion processes, utilizing technologies such as Teradata, Google Big Query, Unix Shell Scripting, and One Automation (UC4). My experience ensures restartability, scalability, and maintainability, involving critical aspects like auditing, file validation, data quality, encryption, and file push to drop zones. In the realm of Big Query, I have developed and optimized SQL queries for complex data transformations, utilizing clusters and partitions for efficiency. Handling JSON parsing and nested data types using Big Query native functions is a part of my skill set. I specialize in monitoring and fine-tuning data pipelines for optimal performance and cost efficiency, coupled with hands-on experience in performance testing for large data sets. My proficiency extends to implementing data archival and purging strategies, managing storage, and extensive work in delimited file processing and validations using UNIX Shell Scripting. I conduct regular data quality checks, ensuring consistency and accuracy, and have developed data quality tools in both Big Query and Teradata, identifying partial data loads. Moreover, I excel in developing metadata-driven Big Query data quality tools, ensuring high standards of data quality. With a knack for loading Dimension and Fact tables in both Big Query and Teradata, I am well-equipped to contribute to your organization's success. Let's connect and discuss how my skills and experience can drive impactful solutions for your business.
Involved in developing data pipelines and ETL for Credit platform
Worked as contractor for Paypal
Created stored procedures and end to end ETL frameworks (Telecommunication domain)