Developed pipeline to fetch costdata from Snowflake, and insights to optimize cost utilization.Designed and developed feature for cost monitoring of clusters in AWS-EMR and Databricks with custom alerts, where users can track cost per each application, user and project in real time . (Java application)Built a secondary pipeline to enrich data from BigQuery for usage and cost monitoring. (Python application).Worked on monitoring Cloudera clusters and generating migration reports to AWS-EMR and GCP Dataproc, rewritten existing code to increase the performance by 70%. In migration reports we track existing cluster usage to suggest cloud instances and storage with pricing. (Java + Python application)Designed and developed features to create and test budgets for EMR and Databricks (Python application).Developed Notifications module, to send notifications through email and slack, the notifications module is used throughout all unravel modules.(Java application)Developed Selenium scrappers to fetch instances cost from AWS-EMR, GCP, Azure, for cost calculation and monitoring. (Python application)Mentored junior developers with KT’s and on easy onboarding to the existing code base to help them contribute easier and up to the coding standards.

I have implemented the enrichment component of the click data in the tracking ingestion. In the enrichment process, all the data required to track the user are added to click and pushed to Kafka with retrial logic and sink. (Java application)Developed Control tower project which helps in organizing and deployment of a project to AWS from details collected from Jenkins deployments, Jira api and GitHub api of a project repository. (Django Application)

Designed and developed the backend for the Mai-Signal, which detects and validates the statistical signals for drugs and led the team on the development of the front end.(Django Application)Developed both backend and frontend for Lit-Mart, Search Engine for Literature search of a suspect drug. (Django Application)Worked on L2A Extractor, which is an Xml data extractor and visualization tool which saved the user time by 70%. (Node Js)

Worked on J-insight, a Java web application and exports them into Prometheus for time series data monitoring, and added Prometheus support to applications. (Java)