Azure Data Engineer
CurrentAs an Azure Data Engineer at Desert Financial Credit Union, I led the design and development of robust data pipelines using Azure Data Factory and Azure Databricks to optimize data ingestion and processing. I deployed Databricks and Delta Lake for ETL pipelines, transforming raw data into actionable insights. Additionally, I managed data governance processes with Collibra and created data workflows in Alteryx for streamlined analytics.Key achievements include:Built and optimized complex ETL pipelines, ensuring data quality and compliance.Integrated AWS services such as S3, Redshift, and Glue for data storage and processing.Implemented real-time data ingestion on Snowflake using Snowpipe and AWS S3.Developed interactive dashboards in Power BI and Tableau using Snowflake.Technologies: SQL Server, ADF, Python, Databricks, Azure Data Lake, Snowflake, Power BI, PySpark, JIRA, Informatica.