San Francisco, California, United States
I am a software engineer passionate about Data Engineering and Distributed Systems. I have 14 years of diverse software engineering experience - Mainframes, Data warehousing, Full Stack Engineering, and Data Engineering. In my experience at Edcite, I helped scale the website to serve 50k users a day. At Insight, I mentored around 75 Fellows to successfully transition to a Data Engineering career. I'm always learning new things and solving problems of scale. Feel free to contact me on LinkedIn!
◆ Promoted to launch a new team composed of diverse expertise; accelerated Fellows’ placement rate by 50%. ◆ Established as an in-house expert on SQL Data Modeling for transactional and data-warehousing analytical systems; Advised Fellows working on data-warehousing projects and conducted data-modeling workshops ◆ Facilitated tailored engineering workshops, working groups, and personal sessions for around 200 Fellows ◆ Resolved skill-gaps in Fellows by formulating a learning framework to learn any new engineering tools/techniques required by Fellows in their career ◆ Engineered a novel assessment platform by tightly integrating various systems via APIs
◆ Mentored and managed around 75 Data Engineering Fellows to land relevant Data Engineering roles at Apple, Grammarly, Disney+, and other relevant companies ◆ Provided technical feedback in all phases of Data Engineering projects for all 75 Fellows, leveraging my software engineering experience ◆ Instilled a rigorous engineering mindset in Fellows by sharing best practices in popular tools like Spark, Kafka, Cassandra, PostgreSQL, etc. ◆ Supervised multiple projects using Apache Spark to process multiple terabytes of data ◆ Used Apache Spark to identify similar songs from a bank of 10k digital MIDI files. Optimized 12 million computations to reduce processing time by 30%
◆ Designed and Implemented a new music recommendation engine that analyses the content of a song. Songs were recommended based on the number of shared instruments between songs. ◆ Enabled ML engineers to build a model that recommends music purely based on musical aspects like chords, chord-progression, rhythm-progression etc.
◆ Ensured smooth functioning of the website's server components. ◆ Achieved 99.99% uptime of website in the school year 2018-19. Took initiative in using tools like ELK, AWS Athena to improve site availability over the course of 4 years. ◆ Accomplished daily averages of ½ million page views and 30k users by fine-tuning the tech stack. ◆ Simplified and improved user adoption by implementing deep OAuth2 API integrations with various vendors(Google, Microsoft, Clever) that had over 7000 daily API interactions with Edcite. ◆ Provisioned more than 150k accounts via API syncs maintaining high standards of data integrity. Achieved this by designing a novel method of outsourcing checks to MySQL, resulting in elegant code. ◆ Deployed fine-grained access to around 4000 customers by engineering a robust and extensible User-Management engine. Built APIs that was used by other developers. ◆ Built a robust data pipeline between NodeJS, MySQL, Cassandra, and Solr. ◆ Researched potential tools that can be used to improve site reliability. ◆ Executed smooth and efficient yearly infrastructure updates.
◆ Involved with large Mainframe applications handling revenues of ~$100m at every stage of designing, coding, reviewing, unit-testing, regression-testing and production implementation. ◆ Reduced IT costs by 15% by writing a tool that identifies and deletes archived or unused datasets. ◆ Onboarded new colleagues by mentoring them and crafting supporting documentation when needed.