Bi & Data Engineer
At Sys Global, I was responsible for analyzing requirements and engaging with senior stakeholders to identify suitable data warehouse (DWH), ETL, and BI solutions. I defined architecture frameworks for data warehousing, ETL, ELT, and real-time streaming, focusing on modeling, metadata, security, and data virtualization. I utilized Databricks clusters for scalable data processing and integrated them with Azure services like ADLS and Azure Synapse Analytics. I designed data integration pipelines using Azure Data Factory (ADF) and implemented Change Data Capture for incremental data loading. My role included developing dynamic pipelines triggered by events and defining dataflows and lineage across the organization. I used Azure Key Vault for secret management and Git for version control. Additionally, I developed and optimized Power BI reports and dashboards to enhance real-time KPI monitoring and data-driven decision-making.