Sushma Jadhav Email & Phone Number

Pune, Maharashtra, India

Developed an ETL process using Spark SQL to clean and transform data from multiple sources and load it into a data warehouse.Developed an automated data cleansing process to reduce manual errors and improve data quality.Automated report generation process using pyspark. Created end to end pipeline data load pipeline using Databricks and Airflow.Modified native data to OMOP CDM for multiple claims and EHR datasets.Spearheaded a team of 4 people.Migrated OMOP conversion pipelines from SQL to Databricks (Delta implementation) which in turn reduced time by 40%.

Pune, Maharashtra, India

Cleaned, Standardized and Transformed raw data with custom-made ETL application to prepare unruly data using Python. Generated exceptions reports based on set criteria. These exceptions are provided to business users for further assessment.Developed python scripts to extract, transform and load data in corresponding tables in oracle database. Understood entity relationship diagram and build relations for tables accordingly. Built a recommendation engine to suggest actions like RCA, turnaround time, action taken, etc. for respective exception. Developed a python script to update data in database for existing exceptions for feedback loop.

Pune, Maharashtra, India

Skills: Python, Natural Language Processing, Data Transformation, Azure Databricks and container.- Cleaned, Standardized and Transformed raw data with custom-made ETL application to prepare unruly data using Python.- Implemented Fuzzy Match NLP algorithm model to identify non exact matching duplicates. Refined algorithm which reduced processing time from 20 min to 2 min for 1 Lac+ entries.- Generated exceptions reports based on set criteria. These exceptions are provided to business users for further assessment.- Deployed the code to Azure Databricks which runs the job in automated fashion and wrote a script which takes required files from Azure Container to Databricks notebook for processing.

Pune, Maharashtra, India

Skills -AWS Redshift, AWS CloudWatch - Worked on syncing data to different environments, blocking query, Unload data, monitor CloudWatch and setting alarms, giving access to users, backup table clean up.Skills: Hadoop, HDFS, AWS S3, AWS EMR, Oozie- Orchestration of Hadoop jobs with help of Oozie.- Running queries using Apache Solr for data searching in Cassandra tables.- Scripts to copy data from AWS S3 to hdfs.- Running commands to trigger EMR in case of failure.- Run Hadoop commands as per need.- Querying tables on Redshift for analyzing data.Skills: Data warehouse, Informatica, Tableau- Worked on mini projects during my training period on Etl technology.

Bachelor Of Engineering, Electronics And Telecommunications

Education record