Azure Data Engineer
Current• Enterprise resource planning is a type of software that organizations use to manage day-to-day activities such as finance, HR, accounting, procurement, project management, risk management, and so on. • Collaborate closely with senior data engineers to create ETL pipeline using Azure ADF. • Use Databricks to write PySpark/ Spark SQL scripts to perform data cleaning, transformation and modeling and loading into the azure • Use the ADF pipeline to load data from… Show more • Enterprise resource planning is a type of software that organizations use to manage day-to-day activities such as finance, HR, accounting, procurement, project management, risk management, and so on. • Collaborate closely with senior data engineers to create ETL pipeline using Azure ADF. • Use Databricks to write PySpark/ Spark SQL scripts to perform data cleaning, transformation and modeling and loading into the azure • Use the ADF pipeline to load data from various sources into azure containers and orchestrate the whole process such as the execution of databricks notebooks.• Use Azure DevOps to maintain git repository and deploy various pipelines. • Perform Data Analysis and Data Quality Analysis of ERP data. Show less