Bengaluru, Karnataka, India
CS enthusiast.
- Had to get familiarised with the Haskell code - Query parser tool and built a spark dataframe code-generator by parsing ASTs generated by QP tool (SQL to dataframe conversion) - Optimised batch processing jobs : resulting in 30% reduction of run time. - Used Bloom filters, parquet(columnar data org), and partitioned data accordingly. - Developed a feature to trigger a mail alert when there is a decrease in jobs.