Azure Data Engineer (Consultant - Am)
CurrentCollaborated with cross-functional teams to design and implement scalable ETL pipelines using Azure Data Factory, Databricks, Spark / PySpark and Python, optimizing data processing for salary and expense forecasting. Leveraged Apache Spark for large-scale data transformation, enhancing data efficiency and accuracy. Implemented Medallion Architecture with.