Bengaluru, Karnataka, India
A versatile professional with expertise in data and AI/ML, focused on building and optimizing data pipelines, data lakes, and lakehouse architectures on AWS (Glue, EMR, Redshift, Lambda, S3, RDS, DynamoDB, Athena, QuickSight, VPCs). Experienced in Python, SQL, and analytics with Pandas/Matplotlib, and in designing and deploying Gen-AI solutions on Amazon Bedrock. Also brings strong IoT/IIoT experience with AWS IoT, Greengrass, PLC/SCADA/DCS systems, industrial protocols (MODBUS, Profibus, MQTT), and edge solutions using Arduino, Raspberry Pi, and ESP. 🔑 Core Competencies: ETL/ELT pipeline development with AWS Glue, Redshift, and Athena. IoT Data Pipeline Development. Gen-AI based solution in AWS. Real-time data streaming using Kinesis Data Streams, Firehose, and Kafka. End-to-end data pipeline visualization using Amazon QuickSight, Kibana, and Grafana. Let’s connect and create impactful solutions together!
•Built and deployed a scalable data lake using Amazon EMR (Trino) and Iceberg tables to improve query performance and analytics with cost reduction. AWS Glue handled data transformation and partitioning, while AWS DMS ingested raw and CDC data. Amazon VPC secured the setup, and CloudWatch ensured monitoring, with Athena used for benchmarking performance. •Architected and deployed a GenAI-powered, serverless incident summarization system using AWS Lambda and Amazon Bedrock (Claude V3 Haiku). It integrated with Amazon RDS Aurora (vector DB) for context retrieval, Amazon S3 for document storage, and API Gateway for client interaction. IAM, CloudWatch, and CloudTrail ensured secure, scalable, and compliant operations. •Architected and deployed a GenAI-powered, smart whatsapp based chatbot for a recommerce platform using meta APIs and Shopify APIs, Amazon Bedrock and AWS Lambda as primary services with IAM, CloudWatch, and CloudTrail ensured secure, scalable, and compliant operations. •Built a GenAI-powered, smart OCR system for extracting offers from fliers and creating relations for integration with transaction data using AWS Glue and also modifying the glue script dynamically to give an analytical dataset. Deployment was thoroughly tested. •Architected a smart auto checkout system for malls to be integrated with smart carts with properly handling session with proper creation of bill and achieving product identification accuracy above 95% using LLM based OCR, Similarity checks with an AWS bedrock knowledge base acting as vectorDB and weight difference validation with a scalable deployment.
• Developed scalable, cost-efficient solutions for managing and analyzing real-time IoT data using AWS IoT Core, MSK, Lambda, and EC2. Data processing leveraged S3, Glue, Redshift, and DynamoDB, while insights were delivered through QuickSight and OpenSearch for handling complex queries. • Built a QuickSight dashboard for player performance analysis by integrating video streams and metadata stored in S3 with DynamoDB session data. Utilized Glue and Athena for data processing and Lambda for orchestration, enabling predictive insights and peer-based comparisons. • Implemented an automated data pipeline for health monitoring of EC2 instances across multiple accounts using Lambda, EventBridge, S3, Glue, and Athena. Delivered real-time insights through interactive QuickSight dashboards, enhancing security with IAM and Backup Audit Manager while maintaining operational efficiency through serverless architecture. • Created financial data visualization pipelines using Glue, S3, and Athena. Interactive QuickSight dashboards provided actionable insights, with Lambda and EventBridge automating scheduling and data extraction. This serverless solution improved accessibility, scalability, and efficiency. • Developed multiple solutions and built the architectures for an IoT solution with multiple protocol for an MNC focusing on reducing cost, flexibility and scalability in Azure. • Evaluated amazon athena queries focussing more on cost reduction for a client and devised a multifaceted solution exploring Athena’s features like reusing/caching query result, efficient data pruning via proper filtering at query and subquery level resulting in a reduction of athena cost by half.
I am co-founder of ‘ezohm solutions pvt ltd’ which mainly deals with embedded and IOT solutions, but I am also looking for a better opportunity where I can put my knowledge and abilities to the work that I am passionate about.