Senior Data Analyst
CurrentThe objective of this project is to design and implement an ETL pipeline that extracts data from various sources, transforms it into a unified format, and loads it into a central data warehouse. The processed data will then be visualized using Power BI to provide actionable insights, trends, and key performance indicators (KPIs).โข Extract data from various sources such as on premises SQL server database, APIs, flat files, and cloud-based MySQL database and csv files stored in Azure Blobโฆ Show more The objective of this project is to design and implement an ETL pipeline that extracts data from various sources, transforms it into a unified format, and loads it into a central data warehouse. The processed data will then be visualized using Power BI to provide actionable insights, trends, and key performance indicators (KPIs).โข Extract data from various sources such as on premises SQL server database, APIs, flat files, and cloud-based MySQL database and csv files stored in Azure Blob Storage using SQL queries and Python scriptsโข Monitor and optimize ETL pipelines for performance, reliability, and scalability.โข Clean and preprocess raw data using Python's Pandas library & SAS data manipulation tools. Handle missing values, outliers, and inconsistencies in the data.โข Responsible for converting intricate data sets into visual representations, such as charts, graphs, and interactive dashboards, utilizing Power BI, Microsoft Power Apps & Python's Matplotlib. Show less