Post by Shreehari Menon

🌟 Wrapping up an incredible summer of research! 🌟 I’m happy to share that I’ve successfully completed the IASc-INSA-NASI Summer Research Fellowship 2025 at IIT Bombay, under the esteemed guidance of Prof. R.K. Shyamasundar. 🔍 My project titled "Privacy-Preserving LLM Training with Federated Learning and Differential Privacy" focused on designing scalable and secure AI systems. Over the course of the internship, I worked on: 🔹 Fine-tuning LLMs (GPT-2, LLaMA 3) using medical datasets 🔹 Implementing Federated Learning pipelines with the Flower framework 🔹 Integrating Differential Privacy using Opacus and PyDP 🔹 Evaluating model performance via BLEU, ROUGE, accuracy & privacy loss (ε) 🔹 Analyzing trade-offs between privacy, performance &communication overhead 🧠 The work lies at the intersection of AI, privacy, and real-world deployment, and has strengthened my interest in building trustworthy machine learning systems for sensitive domains. 🙏 Grateful to Prof. Shyamasundar for his mentorship and technical clarity, and to Syam Mohan for his continuous support and thoughtful discussions throughout. Also enjoyed spending time on the vibrant IIT Bombay campus, exploring its lush greenery, Powai Lake, and getting a small taste of Mumbai’s energy. Looking forward to taking these learnings into future research and collaborations! #SRFP2025 #IITBombay #FederatedLearning #DifferentialPrivacy #LLMs #AIResearch #FlowerFramework #PrivacyPreservingAI #MedAlpaca #OpenAI #NLP #ResearchInternship #SummerResearch