vaibhav panade

About

Data Engineer with hands-on experience in building end-to-end data pipelines using Databricks, PySpark, SQL, and AWS. Experienced in ETL/ELT pipelines, Delta Lake, Lakehouse architecture, batch processing, and data modeling (Fact & Dimension tables). Actively looking for Data Engineer / Associate Data Engineer roles.

Experience

• Data Engineer at Tata Consultancy Services
  May 2024 - Present · 2 yrs 2 mos

  • Built ETL pipelines using Databricks (PySpark & SQL) • Ingested data from AWS S3 into Delta Lake • Implemented Bronze → Silver → Gold layers • Performed data cleaning, deduplication, and transformations • Optimized Spark jobs using partitioning & joins