Singapore
Software Developer/Data Engineer experienced in Java, Scala, Python and Node.JS. Passionate in learning new technologies and frameworks.
• Lead the Data Pipeline and Finance Ops teams across Singapore and Indonesia • Developed a generative AI platform for analysts to standardize reports, reducing reliance on engineers and accelerating business processes by 80% • Designed a central event bus platform for cross-functional data sharing and aggregation using Kafka, AWS KDS, and Flink • Redesigned Hive pipelines into Iceberg pipelines for near real-time marketing and sales reports • Unified the data lake and data warehouse into a single data lakehouse, streamlining analytics and storage • Scaled Apache Airflow to orchestrate 3,000+ dynamically generated DAGs, supporting enterprise-level workloads
• Developed a CDC framework to synchronize changes from upstream to downstream • Built a self-service data platform, enabling business users to independently generate insights • Championed Airflow adoption for orchestrating data pipelines, reducing data latency by up to 30% • Developed and optimized batch ETL jobs in Apache Spark to support large-scale data processing • Defined and implemented SOX-compliant access controls and workflows for the data lake and BI tools
• Built a data profiling tool to detect anomalies early, reducing pipeline reruns by 30% • Tuned and optimized Apache Spark jobs, cutting runtime by up to 6 hours • Performed data analysis, feature engineering, and ETL development to support analytics use cases • Delivered business insights through Tableau dashboards, improving visibility for stakeholders
• Developed a secure data collaboration portal governed by Attribute-Based Access Control (ABAC) • Built and maintained an encryption/decryption library to protect sensitive data across applications • Deployed and managed AWS infrastructure to deliver the product as SaaS
• Developed full-stack applications, leveraging Java for backend and AngularJS for frontend • Built integrations with major cloud storage providers, including Dropbox, Google Drive, SharePoint, and OneDrive