Deputy Manager (Automation Specialist And Insights)
Current• Developed and deployed ETL workflows using Azure Databricks, ensuring efficient data extraction, trans-formation, and loading from diverse sources.• Implemented data cleansing, transformation, and aggregation processes for large datasets to ensure data quality and readiness for analytics.• Utilized Azure Data Lake, Azure Data Factory, and other Azure services to store, process, and manage struc-tured and unstructured data.• Assisted in performance tuning and optimizing Spark-based data processing in Azure Databricks to reduce runtime and increase efficiency.• Ensured compliance with data governance policies by maintaining data integrity, security, and accessibility across cloud platforms. • Actively monitored data pipelines for any issues or bottlenecks and troubleshoot errors to ensure timely and accurate data delivery.