Kshitij Chaudhary

Staff AI Engineer | Agentic AI & RAG Architect | LLM Systems & LLMOps | GenAI Platforms

Hyderabad, Telangana, India

About

• Staff AI engineer with strong experience in designing and building end-to-end RAG pipelines, including data ingestion, chunking, embeddings, retrieval optimization, reranking, grounding, and response validation. • Deep expertise in agent orchestration and multi-agent system design, using planner–worker patterns for task decomposition, coordination, and execution control. • Hands-on experience building agentic workflows using the OpenAI Agents SDK, with structured tool integration and orchestration via Model Context Protocol (MCP). • Strong background in LLM guardrails and reliability, including input sanitization, output validation, grounding checks, policy enforcement, and fallback mechanisms. • Proven experience implementing LLM evaluation frameworks, leveraging LLM-as-a-Judge techniques for relevance, factuality, and quality assessment. • Solid experience in GenAI data engineering, covering data collection, cleaning, transformation, labeling, versioning, and evaluation readiness. • Hands-on experience with LLM fine-tuning using Supervised Fine-Tuning (SFT) for domain-specific adaptation and task specialization. • Strong knowledge of Parameter-Efficient Fine-Tuning (PEFT) techniques for cost-effective and scalable model adaptation. • Strong focus on inference optimization, balancing latency, context window usage, throughput, and model selection trade-offs. • Extensive LLMOps and production deployment experience on AWS.

Experience

  • Engineering Manager AI at Deloitte
    Apr 2026 - Present · 3 mos

  • Staff Software Engineer at Carbon
    Dec 2020 - Nov 2025 · 5 yrs

  • Lead QA Engineer at S&P Global
    Sep 2019 - Dec 2020 · 1 yr 4 mos

  • Consultant at Deloitte
    May 2017 - Sep 2019 · 2 yrs 5 mos

  • Senior Test Engineer at UnitedHealth Group
    May 2016 - Apr 2017 · 1 yr