Azure Data Engineer
Current•Built efficient data pipelines in Azure Data Factory and Databricks, increasing data throughput by 40%.•Developed big data solutions with Azure Synapse, using T-SQL and Python to improve data analysis.•Architected BI solutions with Azure Data Lake, enhancing data access for healthcare analytics.•Optimized ETL processes with PySpark in Azure Synapse, boosting data processing efficiency by 35%.•Managed real-time data streaming with Kafka and Spark, ensuring high data quality.•Secured data transfers from SQL Server to SFTP using Azure Databricks workflows.•Designed Snowflake data integration with PySpark, improving data management.•Enhanced data visualization with Alteryx and SQL for Tableau Server.•Monitored system health using the ELK Stack and automated Azure provisioning with Terraform, reducing setup time by 20%.