Indranil Pal Email & Phone Number

Kolkata, West Bengal, India

Develop DAGs to schedule tasks for scalable data pipeline, using Python3, SQL and bash command in Apache Airflow and deploy in GCP using composer to extract data from BigQuery table, transform data and load into GCS bucket for a leading retailer in the US.Design and develop a data ingestion system using Pub-Sub, Cloud function to fetch data from http endpoint and store them as json file into GCS bucket and later load them into BigQuery as table by following event-driven architecture. Schedule this system using Cloud scheduler and deploy in GCP.

Kolkata, West Bengal, India

Develop a streaming/batch pipelines, to extract raw data from GCS bucket, using cloud function, Pub-Sub and load them back into the GCS bucket by deploying to higher environments through github and jenkins.Design and implement an application for customer matching for a policy admin system to group under a unique customer id using Python3 in insurance projects for a leading Insurance provider in the UK.

Kolkata, West Bengal, India

Done detailed analysis, build work and scheduled a set of applications which runs SAS programs, as a part of a data migration team.Develop a file monitoring system to monitor the SLA performance of some business critical files and will raise incidents in SERVICENOW if the files do not meet SLA.Built an automatic email notification system to notify the customers about their invested fund details from the database before a given time of the retirement date using SAS.

Kolkata, West Bengal, India

Played multiple roles in different sub projects in the ETL process