Soham Deo Email & Phone Number

Mumbai, Mh, In

Mumbai, Maharashtra, India

• Client : HDFC ERGO❖ Roles/ Responsibilities:o Designing end-to-end Aws serverless data pipeline and data lake using AWS component.o Responsible for maintaining quality data in delta lake by performing operations such as cleaning, transformation and ensuring Integrity by working closely with the stakeholders and solution architect.o Implementing different data pipeline layers like building ingestion layer, transformation layer and consumption layer.o Implementing delta lake for different business use case.o Developed reusable framework to be leveraged for automated ETL from RDBMS systems or s3 file path to the Data Lake utilizing Spark Data Sources and config file.

India

In wine making, fermentation decides the quality of wine. So tracking wine fermentation attributes is very important and it is a time consuming process. To prevent wine from going astray by providing alerts, warnings and intervention suggestions❖Roles/ Responsibilities:o Involved in requirement gathering and architecture design of the project for machine learning implementation.o Integrating data from multiple data sources and developing a data lake.o Identifying opportunities for effectively fulfilling requirements via automation.o Delivered machine learning solutions as per business requirements.o Created analytical datasets by extracting, manipulating, and consolidating huge datasets with >4 million records.

India

Lifetime of bearing is calculated during the initial product design, but wrong working conditions unpredictable failure of the system. The entire assembly is usually compromised when a bearing has a failure, causing high costs. Predictive maintenance of bearing allows a continuous monitoring of bearing performance and critical parameters.

Mumbai Area, India

o Involved in importing inbound data (Ex using Sqoop.o Designed data warehouse using Hive, created and managed Hive tables.o Hive tables with partitioning and bucketing conceptso Regularly performance tune of queries to improve data Metadata, Inbound Measure data) from RDBMS to HDFS processing and retrievingo Developed spark code using python for faster testing and processing of data.o Live data streaming for pricing markets using Spark Streaming.o Inbound and Outbound batch jobs in SQL and PL/SQL Developer.o Created dashboards on Kibana that led to reduction of manual work by a great amount.o Communicating client about changes in system and DIS.

Maharashtra, India