Data Sourcerer
CurrentIn my current role, I am responsible for a wide range of data engineering activities for the MidCentral primary health care data warehouse, known as Te Kete Kōrero. I actively monitor and troubleshoot existing ELT (Extract, Load, Transform) processes originating from diverse source systems, wit varying architectures between them that require normalisation, deduplication and integration for consumption. Currently, I am focused on spearheading the development of a new Inmon-styled layer… Show more In my current role, I am responsible for a wide range of data engineering activities for the MidCentral primary health care data warehouse, known as Te Kete Kōrero. I actively monitor and troubleshoot existing ELT (Extract, Load, Transform) processes originating from diverse source systems, wit varying architectures between them that require normalisation, deduplication and integration for consumption. Currently, I am focused on spearheading the development of a new Inmon-styled layer for our data architecture. This initiative will revolutionise our querying capabilities by modelling and building data domains that mirror the concepts and processes familiar with professionals working in the health sector. By aligning our data models with their existing knowledge, we drastically cut down on the work to develop new dashboards and explore new insights as querying our data models are infused with the business intelligence of our team and conform to in-use standards. Further, this will improve consistency and replicability of our reporting in an environment under the stress of change from the ongoing health reforms.Notable achievements in this role include:1. Automated Maintenance of Indexes: Implemented an automated process for maintaining indexes in our data warehouse, optimising performance and ensuring data accessibility.2.Kimball-Styled Data Marts: Developed several Kimball-styled data marts, providing specialised subsets of data tailored to different analytical needs within the organisation.3. Engineering PowerBI Dashboard: Took ownership of creating an engineering-focused PowerBI dashboard, encompassing data collection, processing, and visualization. This dashboard offers vital statistics such as server storage capacity and utilisation, index information, data reconciliation statistics, and the timeliness of our source data, simplifying the preventative maintenance and speeding up the diagnosis of issues. Show less