Surendra Pal Email and Phone Number
Surendra Pal is a Data Engineer | AWS certified - {AWS Redshift | Glue ETL | Databricks | Python/Pyspark | SQL | Airflow | Step function | Event bridge | AWS Lake formation | AWS DMS }Ex-TEBillion, Accenture at Bureau Veritas Group.
Bureau Veritas Group
View- Website:
- bureauveritas.com
- Employees:
- 33137
-
Data EngineerBureau Veritas Group Jun 2024 - PresentMumbai, Maharashtra, India -
Data EngineerTebillion.Com Mar 2021 - May 2024Mumbai, Maharashtra, India•AWS Cloud practitioner certified •AWS Solution architect associate certified •Working with redshift for a reputed company we maintain there end to end data transaction from souce to destinatation with GLUE as an etl tool, for historical data we use spectrum as the data storage. We process the data to report using ReportManager2(Apache Airflow). We use S3, Glue, Redshift, Lambda, Spectrum, Python, Pyspark for data process and data saving & we are using periscope for graphs monitoring.•We have Optout process which is monthly jobs and has the retention policy for 30 days and All the older historical data get store in spectrum and history Optout cluster. Historical data more than 2 years get permanently deleted from cluster and spectrum.•Coordinate with Datascience team (client side) and work on Query Optimization & logics of the scripts. Setup cronjobs for new ETL jobs for those scripts •Creating new data pipeline code in python to execute SQL script and setting up independent jobs in crontab hourly,daily, monthly process on EC2 instance for redshift cluster.•Working with Databrick for the same project as above we have jobs which run as the ETL and popluated the data hourly, weekly, monthly & yearly. The data is based on use watch session over TV.•Automated the manual data reconciliation process between the different sources, increasing the data accuracy and efficiency by 90%Automated ETL processes, making it easier to wrangle data and reducing time by as much as 40%Increased the efficiency of the data fetching by approximately 30% using query optimization and indexing -
Claims AnalystAccenture Feb 2019 - Apr 2020Mumbai, Maharashtra, IndiaWorking on an Citrix virtual app and investigating customer and providers SSN details and the services for those customers. Following proper procedure flows to take appropriate action for the same. manage to work on multiples IBM AS400 emulator and testing the automation tools for processing those claims in a proper format and in appropriate way.
Surendra Pal Education Details
-
R. D. National CollegeComputer Science -
Rd National CollegeComputer Science
Frequently Asked Questions about Surendra Pal
What company does Surendra Pal work for?
Surendra Pal works for Bureau Veritas Group
What is Surendra Pal's role at the current company?
Surendra Pal's current role is Data Engineer | AWS certified - {AWS Redshift | Glue ETL | Databricks | Python/Pyspark | SQL | Airflow | Step function | Event bridge | AWS Lake formation | AWS DMS }Ex-TEBillion, Accenture.
What schools did Surendra Pal attend?
Surendra Pal attended R. D. National College, Rd National College.
Who are Surendra Pal's colleagues?
Surendra Pal's colleagues are Ticiane Altoe Nicoli, Frédéric Grandin, Thomas Kerignard, Casper Høj Sørensen, Ty Dodge, Rowena V., Fabiano Abreu Ferreira.
Not the Surendra Pal you were looking for?
-
2cognizant.com, gmail.com
2 (888)-2XXXXXXX
-
Surendra Pal
Head Of Global It Programme, Project And Portfolio Management At Ammega Groups, Ex-British Council, Prince 2 Agile Practitioner, Itil PractitionerSouth Delhi2gmail.com, britishcouncil.org -
-
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial