Pradeep Kumar Sarangi Email & Phone Number

Copenhagen, Dk

Copenhagen Municipality, Capital Region Of Denmark, Denmark

Copenhagen, Capital Region, Denmark

• Developed Spark applications for data extractions, transformation and aggregation from multiple systems and stored on Azure Data Lake Storage using Databricks notebook.• Created and maintained ADF pipeline to copy data from ADLS to MS SQL for reporting.• Tuned down the jobs for better performance in various levels.Designed and maintained the EDW that stored over 1 PB of data, enabling data-driven decision making for key business initiatives.• Developed and implemented data governance and reconciliation solution.• Migrating tables from ADLS to Unity Catalog.• Setting up CI/ CD pipeline.• Provide full operational support - analyze job to identify the root cause of production issues and provide solutions or work arounds and lead to its resolution.

Helsinki, Uusimaa, Finland

• Built and managed Data Pipelines and Jobs with Databricks (Delta Tables, Spark, Scala, SQL) and Azure Data Factory to streamline data processing. • Designed and implemented complex ETL pipelines using Databricks (Spark, Scala SQL) and Azure Data Factory to efficiently ingest and transform data from multiple sources into a Data Lake and Azure SQL Database.• Automated data processing and improved efficiency using Databricks Jobs and Data Pipelines with Spark, enhancing overall data processing accuracy.• Provide full operational support - analyze job to identify the root cause of production issues and provide solutions or work arounds and lead to its resolution.• Ingesting & exporting data to & from SAP.• Ability to apply spark data frame API, creating UDF’s and SQL scripts for automation.

Bengaluru, Karnataka, India

• Loaded and transformed large sets of structured, and semi structured data using spark, scala and hive.• Worked independently on stories to pull data and transforming them in required format using Spark Scala.• Scheduled and automated the jobs using Automic.• Provided full operational support - analyze job to identify the root cause of production issues and provide solutions or work arounds and lead to its resolution.

Madrid, Community Of Madrid, Spain

• Worked with inhouse development team to develop dispatching solution.• Automated the reconciliation process for the plants.• Used web services to fetch/ send data from/to external applications.• Developed and maintained the reporting solution.

Bhubaneshwar Area, India

• Worked as a web developer to develop large scale e-Governance application.• Developed API to fetch data from external application.• Developed procedures, functions, triggers and cursors to process large volume of data.• Handled the request/ load using web farming.