Pradeep Kumar Sarangi Email & Phone Number

Copenhagen Municipality, Capital Region Of Denmark, Denmark

Copenhagen, Capital Region, Denmark

• Developed Spark applications for data extractions, transformation and aggregation from multiple systems and stored on Azure Data Lake Storage using Databricks notebook.
• Created and maintained ADF pipeline to copy data from ADLS to MS SQL for reporting.
• Tuned down the jobs for better performance in various levels.Designed and maintained the EDW that stored over 1 PB of data, enabling data-driven decision making for key business initiatives.
• Developed and implemented data governance and reconciliation solution.
• Migrating tables from ADLS to Unity Catalog.
• Setting up CI/ CD pipeline.

Helsinki, Uusimaa, Finland

• Built and managed Data Pipelines and Jobs with Databricks (Delta Tables, Spark, Scala, SQL) and Azure Data Factory to streamline data processing.
• Designed and implemented complex ETL pipelines using Databricks (Spark, Scala SQL) and Azure Data Factory to efficiently ingest and transform data from multiple sources into a Data Lake and Azure SQL Database.
• Automated data processing and improved efficiency using Databricks Jobs and Data Pipelines with Spark, enhancing overall data processing accuracy.
• Provide full operational support - analyze job to identify the root cause of production issues and provide solutions or work arounds and lead to its resolution.
• Ingesting & exporting data to & from SAP.
• Ability to apply spark data frame API, creating UDF’s and SQL scripts for automation.

Bengaluru, Karnataka, India

• Loaded and transformed large sets of structured, and semi structured data using spark, scala and hive.
• Worked independently on stories to pull data and transforming them in required format using Spark Scala.
• Scheduled and automated the jobs using Automic.
• Provided full operational support - analyze job to identify the root cause of production issues and provide solutions or work arounds and lead to its resolution.

Madrid, Community Of Madrid, Spain

• Worked with inhouse development team to develop dispatching solution.
• Automated the reconciliation process for the plants.
• Used web services to fetch/ send data from/to external applications.
• Developed and maintained the reporting solution.

Bhubaneshwar Area, India

• Worked as a web developer to develop large scale e-Governance application.
• Developed API to fetch data from external application.
• Developed procedures, functions, triggers and cursors to process large volume of data.
• Handled the request/ load using web farming.