Joshi G Email & Phone Number

 Designed and developed ETL (Extract, Transform, Load) pipelines usingAWS services such as Glue, Lambda, and S3 to extract data from varioussources, transform it and load it into a data warehouse. Build and maintain scalable and highly available data solutions using AWSservices such as Redshift, RDS, and DynamoDB. Extensively worked with the application.

Worked on Pandas DataFrame operations to clean and preprocess raw data,handling missingvalues and outliers.Developed an ETL process to transform raw data into a structured formatusing tools such asCloud Dataprep and Cloud Functions.Utilized Apache Beam to construct complex data transformation, ensuring dataquality andconsistency. workflowsDeveloped and.

• Migrated the Snowflake database to Windows Azure and updated theConnection Strings based on the requirement.
• Developed Talend MDM jobs to populate the claims data to data warehouse -star schema, snowflake schema, Hybrid Schema.
• Developing Spark applications using Spark-SQL in Databricks for dataextraction, transformation, and aggregation from multiple file formats forAnalyzing& transforming the data to uncover insights into the customer.
• Creating pipeline jobs, scheduling triggers, Mapping data flows using AzureData Factory(V2), and using Key Vaults to store credentials.
• Creating Elastic pool databases and scheduling Elastic jobs for executingTSQL procedures.
• Extract Transform and Load data from sources Systems to Azure DataStorage services using a combination of Azure Data factory, T-SQL, SparkSQL, and U-SQL Azure Data Lake Analytics. Data ingestion to one or moreAzure.

• Hands on experience in Spark and Spark Streaming creating RDD & applyingoperations, transformations, and Actions.
• Used Python with Apache Spark for distributed data processing on Hadoopclusters.
• Used Spark and Spark-SQL to read the parquet data and create the tables inhive using the ScalaAPI.
• Developed Spark code using Scala and Spark-SQL for faster processing andtesting.
• Designed and implemented complex data processing pipelines using Scalaand Apache Spark.
• Experienced Good understanding of NoSQL databases and hands on workexperience in writing applications No SQL Databases HBase, Cassandra andMongoDB.

Master'S Degree, Computer And Information Sciences

Bachelor'S Degree, Electronics And Communications Engineering