• Worked on migration of data from On-prem SQL server to Cloud databases (Azure Synapse Analytics (DW) & Azure SQL DB).• Designed and Configured Azure Cloud relational servers and databases analysing current and future business requirements.• Responsible for estimating the cluster size, monitoring and troubleshooting of the Spark data bricks cluster.• Designed and implemented effective database solutions (Azure blob storage) to store and retrieve data.• Wrote SQL and PL/SQL programs to identify and correct data anomalies at request of SME's.• Used Python pandas as API to put the data as time series and tabular format for manipulation and retrieval of data.• Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.Developed a data pipeline for monthly reporting of financial contracts and automated the ingestion process by 60% reducing 3 hours of manual work every week. • Worked on migration of data from On-prem SQL server to Cloud databases (Azure Synapse Analytics (DW) & Azure SQL DB). • Designed and Configured Azure Cloud relational servers and databases analysing current and future business requirements. • Responsible for estimating the cluster size, monitoring and troubleshooting of the Spark data bricks cluster. • Designed and implemented effective database solutions (Azure blob storage) to store and retrieve data. • Wrote SQL and PL/SQL programs to identify and correct data anomalies at request of SME's. • Used Python pandas as API to put the data as time series and tabular format for manipulation and retrieval of data. • Worked on creating tabular models on Azure analysis services for meeting business reporting requirements. • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability. • Involved in developing spark applications in Data bricks to uncover customer usage patterns.