Post by Big Data Week

3,984 followers

Now onto our second session at Bucharest Big Data meetup: Comsa Roberto-Marian, Data Engineer at eSolutions.tech on, is unpacking why data validation matters in CDC streaming pipelines. Through a practical production journey spanning CDC sources, NiFi, Kafka, Spark, and Delta Lake on MinIO, Roberto is showing how powerful real-time data products can be, but also how subtle drift and unnoticed issues can quietly impact data quality, reliability, and trust. A strong takeaway from the session: even when heavy validation at the source isn’t possible, lightweight checks and stronger end-to-end ownership can go a long way in catching issues early and building more resilient streaming platforms. #bigdatameetup #bigdatabucharest #bigdata #cdc #datavalidation #kafka #spark #nifi #deltalake #minio #streamingdata #dataengineering #eSolutions

Post contentPost contentPost content