Sujoy Pal Email & Phone Number

Remigrating and re platforming data from SQL server to data mart.Data transformation using pyspark.So mapping new attributes and business logic. Handling case raised by clients,fixing bugs,enhancing functionalities and answering technical and logical enquiries.Analysing and handling the various use cases .Designed and developed reports based on specific business requirements to provide meaningful and insightful data analysis.Worked with large-scale datasets and leverage PySpark's distributed processing capabilities to perform data transformations, cleaning, aggregation, and other processing tasks. This involved writing PySpark code to apply transformations on the data and optimize performance.Monitored the performance of PySpark jobs, logging details and identified bottlenecks for performance issues.Automated workflows and data copy/migration activities using Azure Data Factory tool.Configured and managed Azure Databricks clusters to run PySpark jobs efficiently.Tools used- Snowflake, Dbeaver,Unix, Jenkins

Kolkata, West Bengal, India

Worked here as an ETL developer in Insurence domain and processed almost 7 million monthly data in every Production run.Fulfilled business requirements such as ad hoc runs,Policy and party analysis,Job trigger.Worked on 3 fully automated UNIX scripts to enhanced the overall process.Tools used - ETL (Extract Transform Load), MySQl, Informatica, Unix

Kolkata, West Bengal, India

Analyse the data to fulfilled BAU requirement.Discussed requirements with clients and analyzing and translating them into technical or fictional specification as well as designing,testing,debugging,documenting and adding new features and functionalities as a part of BAU.Tools used - ETL (Extract Transform Load), MySQl, Informatica, Unix