Bengaluru, Karnataka, India
With a strong foundation in PySpark, distributed systems, and cloud-native data pipelines, I specialize in building scalable, fault-tolerant platforms that power mission-critical data flows across domains like healthcare, compliance, and real-time analytics. At Exxat and Blue Yonder, I’ve led the architecture of multi-source, multi-sink data pipelines—across CosmosDB, MongoDB, SQL Server, Snowflake, and Elasticsearch—leveraging streaming frameworks and modern orchestration tools. My focus is on: Data platform reliability, observability, and self-healing design Platform-level deletion workflows for regulatory compliance (GDPR, HIPAA) Automation-first DevOps with Logic Apps, Terraform, and CI/CD pipelines Productivity tooling via LLM/prompt engineering frameworks for PySpark I thrive at the intersection of architecture and execution—aligning business goals with technical scalability and mentoring teams toward engineering excellence.
Engineered streaming pipelines in PySpark across CosmosDB, MongoDB, Elasticsearch, and SQL Server, enabling ~1.5 TB/day ingestion with CDC and resilient checkpointing Developed real-time dashboards for sync latency, throughput, and error detection, reducing incident rollback time by ~40% Led GDPR-compliant deletion workflows with automated verification, achieving 100% verified off-boarding across DBs and blob stores Mentored 3+ engineers and drove data platform onboarding sessions, raising team productivity Automated end-to-end job triggers with Azure Logic Apps and DevOps pipelines—cutting manual intervention by 80%
Designed and scaled data ingestion platform using Snowflake + Airflow + Docker, reducing pipeline lag and boosting observability via log-driven alerts. Built reusable microservices in FastAPI to serve data APIs for product modules—containerized, CI/CD-enabled, and monitored in production. Reduced production incidents by 40% through robust incident workflows, proactive monitoring, and permanent fixes integrated into Airflow DAGs. Mentored engineers in software architecture, clean coding, and ETL best practices; led code reviews across teams. Collaborated with architects on high-availability deployment of analytics platforms used across supply chain verticals.
Analyze, debug and/or assist in problem-solving in both development and production environments. Responsible to build scalable REST APIS using python / Django framework and PostgreSQL. Actively taking part in high-low-level design on product modules. Provide regular estimation of JIRA tasks and mentor junior developers for their task completions. Assist Scrum master and principal engineers to prepare JIRA backlogs and module implementation planning. Implementation of SOLID principals and OOPS design patterns. Taking part in code review
Responsible to design, implement and deliver the product/module. Worked as Technical/Manager Lead of the product/Module. Design Product workflows and DB. Coaching junior members of the team to take the task and execute it from end to end. Involves in multiple technical R&D tasks to design the approach to solve the problem statement. Got exposed to dirtying my hand with multiple technologies. Leading a team of 5 members, the number of team members varies basis on the requirement of the product/module/client. Key technologies, I have used Python, NodeJs, MERN, Django, API design, DB Design (Postgres/MySQL/Aura/AWS RDS/MongoDB), AWS, RDF, SPARQL, Android/IOS/Hybrid Design UI flow as technical aspects.