Data Engineer
CurrentEnd-to-end data pipeline development in Azure ML Workspace and Azure Data Factory (ADF)Extract, transform, and load data from diverse sources (Azure SQL, Blob storage, Azure SQL Data Warehouse, write-back tools)Spark application development using Pyspark and Spark-SQL for data extraction, transformation, and aggregationPerformance tuning of Spark.