Data Analyst
Current1. Tabung Haji Data Warehouse Development:• Perform data source gathering and develop a comprehensive data dictionary (column mapping) for reference.• Automate the column mapping and data dictionary creation process through Python scripts, minimizing manual intervention.• Design and implement dimensional data modelling for storing fact and dimension tables in the data warehouse, specifically for Hajj and Deposit modules.• Develop ETL pipelines using SSIS for both full and incremental loads, accommodating one-time events and regular schedules.• Deploy SSIS packages, schedule jobs, and continuously monitor the pipeline’s performance, addressing failures and optimizing processes as needed.• Create data marts for reporting on Hajj and Deposit data, facilitating business insights.• Involve in TOT sessions with both business users (Hajj and Deposit) and technical teams.• Enhance ETL performance through indexing, SSIS configuration adjustments, and the removal of redundant tasks or functions.2. Smart Parking (PSP & KSP) & Open Project:• Orchestrate ETL processes using Apache Airflow, developing Python scripts to streamline workflows.• Ensure smooth ETL operations by monitoring processes and addressing issues promptly.• Apply data transformation techniques using Power Query, DAX, and M-language in Power BI, followed by visualizing the data effectively.3. JPJ MyStat:• Develop DB2 views for generating statistical reports required in dashboards.• Execute data transformation tasks in Spotfire prior to visualization.4. MOTAC:• Support dashboard development in Grafana, adhering to business specifications.