Chennai, Tamil Nadu, India
As a Data Engineer, my role involves crafting scalable data pipelines, leveraging Databricks, Power BI, and machine learning, harnessing the power of PySpark and SQL to solve Data problems and deliver Business insights. But let me be clear — I wasn’t hired to build pipelines. I was hired to deliver outcomes that move the needle for the business. I use tools and techniques not just to "get things done" — but to create real, measurable Business Impact. 1. → Not "I built a model" → But "I developed an ML-based line-haul prediction system that reduced late deliveries by 25%" 2. → Not "I built a dashboard" → But "I gave the sales team visibility that unlocked revenue in vital areas" 3. → Not "I prepared the data" → But "I fixed the pipeline that unblocked data from 5 endpoints, enabling decision-making for 3 key stakeholder groups across the company" 𝑻𝒉𝒂𝒕’𝒔 𝒘𝒉𝒚 𝑰 𝒘𝒐𝒓𝒌 𝒂𝒔 𝒂 𝑫𝒂𝒕𝒂 𝑬𝒏𝒈𝒊𝒏𝒆𝒆𝒓!
- Designed and built scalable pipelines using PySpark, SQL, and Delta Lake on Databricks, migrating complex logic from Synapse and converting stored procedures into modular PySpark workflows. - Built real‑time Power BI dashboards integrated with Fabric components, enabling business stakeholders to visualize KPIs seamlessly and validate reporting accuracy. - Followed the Define–Design–Develop framework and Mendellian architecture for warehouse layer development, pipeline governance, and migrated Databricks objects from Hive Metastore to Unity Catalog. - Optimized workflows and built Genie Rooms for intelligent answering.
- Collaborated closely with the product development team to design, and prototype new cybersecurity tools. Tested and evaluated prototypes to ensure functionality, reliability, and effectiveness, to meet quality standards. - Worked as a part of the Backend Team utilising various python libraries for Reverse Engineering and building the application structure.
- Conducted comprehensive analysis of the College Lab Block connections, including mapping out the network architecture, identifying potential vulnerabilities. - Leveraged various network analysis tools and techniques such as network scanning, packet analysis, and vulnerability assessment.
- Being a part of the Robotics and Automation Team, designed Soft Automation techniques for Robotic Systems, focusing on tasks that require adaptive and intelligent decision-making, such as pattern recognition, and predictive modeling. - Held webinars for co-interns and students from different teams within the company on Data Analysis, Computational Intelligence and Monte-Carlo methods and workflows.