Deputy Manager (Automation Specialist And Insights)
Current- Developed and deployed ETL workflows using Azure Databricks, ensuring efficient data extraction, trans-formation, and loading from diverse sources.
- Implemented data cleansing, transformation, and aggregation processes for large datasets to ensure data quality and readiness for analytics.
- Utilized Azure Data Lake, Azure Data Factory, and other Azure services to store, process, and manage struc-tured and unstructured data.
- Assisted in performance tuning and optimizing Spark-based data processing in Azure Databricks to reduce runtime and increase efficiency.
- Ensured compliance with data governance policies by maintaining data integrity, security, and accessibility across cloud platforms.
- Actively monitored data pipelines for any issues or bottlenecks and troubleshoot errors to ensure timely and accurate data delivery.