Singapore
Enterprise Data Architect | Data Engineering Leader | AI-Ready Data Platforms I help organizations transform data into trusted business assets by architecting modern data platforms that power analytics, intelligent decision-making, and AI. My expertise spans Enterprise Data Architecture, Modern Data Engineering, Lakehouse Architecture, Cloud Data Platforms, Data Governance, Data Integration, Business Intelligence, Analytics Engineering, and Data Product Development. I have designed and delivered enterprise software and data products including Spotlight, Analytica, FraudSentry, APAS (Asset Performance Analytics System), CostDB, ETL Mapper, DataTram, and FarmToHatch, together with numerous in-house Business Intelligence applications. I have also architected and implemented Enterprise Data Warehouses (EDW), Data Marts, Operational Data Stores (ODS), Enterprise Data Hubs (EDH), Data Lakes, Lakehouse platforms, and enterprise reporting solutions across healthcare, banking, manufacturing, semiconductor, aviation, maritime, real estate, government, and technology sectors. My recent focus is on building AI-ready cloud data platforms using Databricks, Informatica Intelligent Data Management Cloud (IDMC), Delta Lake, Unity Catalog, AWS, and Azure, delivering Lakehouse modernization, cloud migration, scalable data ingestion, metadata management, governance, dimensional modelling, performance optimization, secure data sharing, and architectures that support analytics, machine learning, and generative AI. I have held leadership and specialist roles including Data Engineering Manager, Principal Consultant, Senior Data Architect, BI Solution Architect, Enterprise Information Management (EIM) Manager, ETL Architect, Business Analyst, Software Engineer, and Technical Lead, partnering with business and technology leaders to modernize enterprise data platforms and deliver scalable, business-driven solutions. I hold Microsoft Certified: Azure Data Engineer Associate, AWS Cloud certifications, and IBM Certified Solution Expert credentials. I enjoy helping organizations build trusted, governed, and future-ready data ecosystems that transform data into business value.
*Spearheaded the design and implementation of a large-scale data migration project to Databricks for the Healix platform, ensuring seamless transition and scalability. * Architected a robust data migration framework utilizing PySpark, Databricks Delta Lake, Databricks Workflows, and AWS S3, optimizing performance and reliability. * Automated the ingestion and transformation of terabyte-scale files into Delta tables, ensuring accurate and efficient data loading. * Implemented workflows to handle high-volume data pipelines, incorporating file decryption, decompression, and validation processes. * Enhanced data integrity through automated checks for file checksum validation and row-level reconciliation across datasets. * Collaborated with cross-functional teams to deliver a scalable and reusable framework, improving overall project timelines and reducing manual intervention. * Leading data engineering projects in healthcare, from start to finish, ensuring smooth delivery of BI dashboards and data pipelines. Crafting robust data architectures to support efficient data flow and storage, enhancing overall productivity.
As a Senior BI/DWH Analyst, I am accountable for optimizing and maintaining the existing BI/DWH system, developed with Oracle, DataStage, Cognos, MicroStrategy, and Oracle Golden Gate. My role involves conceptualizing, planning, and executing the seamless migration of the legacy DWH and BI infrastructure to Azure. This transition encompasses harnessing Azure's big data processing capabilities, leveraging resources like Azure Storage and Synapse, and integrating Power BI for advanced visualization.
As a Data Practice Lead for YTL, I have had the privilege to work on exciting projects where I've helped design big data platforms to provide a common platform for enterprise information needs. My responsibilities as a Data Architect include: Enterprise Datwarehouse Architect: I have designed enterprise data warehouses to enable efficient data management practices, including data integration, data cleansing, and data quality control. Power BI Solution Architect: I have helped organizations implement Power BI solutions to create dynamic visualizations and interactive dashboards that provide real-time insights into their business operations. ODS & Data mart solution Architect: I have designed and implemented operational data stores (ODS) and data marts to enable businesses to gain a holistic view of their data assets and make informed decisions. Azure Data Factory ETL Designer: I have designed and implemented ETL processes using Azure Data Factory to enable efficient data movement and transformation across various data sources. Real-time data integration Solution Designer: I have designed and implemented real-time data integration solutions to enable businesses to make decisions based on up-to-date information. Additionally, I have been a key member of the Data Governance Council and have helped define best practices for data management across the organization.
As a Principal Consultant, I was responsible for providing end-to-end solutions for designing and implementing big data, enterprise data warehouse, data mart, data lake, and BI applications for clients across industries. I ensured that all projects were executed according to best practices, standards, and guidelines, while meeting clients' requirements. In my recent role, I have designed and implemented a real-time enterprise data hub for Jurong Port in Singapore using Attunity, Amazon Redshift, S3, IOT Gateway, API Gateway, Cloudwatch, Kinesis, firehose, Python, Lambda, and Power BI. This project required a comprehensive understanding of data management, data modeling, ETL processes, and real-time data ingestion, which I leveraged to deliver a successful project that met the client's needs. Additionally, I have architected end-to-end solutions to productize Data Archival, Restore and Purging capabilities for Enterprise data warehouse. This involved collaborating with various stakeholders to ensure that the solutions met the business requirements and adhered to industry standards. Furthermore, I advised on creating data warehouse design principles and an approach for developing a data analytics platform for NUS, Singapore. This project required me to draw on my expertise in data architecture, data modeling, ETL processes, and BI applications to ensure that the platform was optimized for analytics and could deliver valuable insights to the client. Overall, my role as a Principal Consultant required a combination of technical and managerial skills, including project management, team leadership, stakeholder management, and problem-solving. My achievements in these projects demonstrate my ability to deliver high-quality solutions that meet clients' needs while adhering to industry standards and best practices.
As a Senior Data Architect, my role was to specialize in creating blueprints for data management systems and designing a plan to integrate, centralize, protect, and maintain large-scale data processing systems (Big Data Platform). My focus was on preparing structured or unstructured data for analytic modelling or BI reports/dashboards. One of my most significant achievements was designing and implementing a Data Lake and Data Mart for Singapore Airlines using Hadoop, Amazon Redshift, AbInitio, and Tableau. This project involved working closely with the airline's data team to identify their specific requirements and ensure the solution met their needs. I was responsible for defining the overall architecture, including data models, data flows, and data processing pipelines, as well as ensuring that the system was scalable, reliable, and secure. Additionally, I oversaw the implementation of the solution and ensured that it was integrated with other relevant systems and tools.