Data Engineer (External Consultant)
Current> Build and optimize data pipelines, ensuring AXA is optimizing its Cloud spend and has full transparency of all its Cloud costs.> Perform data transformation tasks, including data cleansing, aggregation, enrichment, and normalization, using Databricks.> Monitor and troubleshoot data pipelines, identifying and resolving performance issues and data quality problems> Deploy scalable infrastructure and automate tasks using Terraform and Azure DevOps.> Stack: Databricks, Azure Data Factory, Terraform, Azure DevOps, Azure Synapse Analytics, Azure Automation, Azure Datalake Storage Gen2, Entra ID, PowerBI | PySpark, Pandas, SQL. YAML, PowerShell