Michael Hore Email & Phone Number

Melbourne, Victoria, Australia

Data engineering & engineering leadership- Built a data engineering framework - faster time-to-deliver, increased quality, standardized pipelines & transformations, innovative transformation modularization with pyspark, enforced Data Vault 2 rules, "soft" updates/deletes, set-based updates/replacements, optimized multi-batch processing, delete inference- Built a distributed & efficient cooperative table-locking scheme for databricks using S3 storage backend, to avoid concurrent write… Show more Data engineering & engineering leadership- Built a data engineering framework - faster time-to-deliver, increased quality, standardized pipelines & transformations, innovative transformation modularization with pyspark, enforced Data Vault 2 rules, "soft" updates/deletes, set-based updates/replacements, optimized multi-batch processing, delete inference- Built a distributed & efficient cooperative table-locking scheme for databricks using S3 storage backend, to avoid concurrent write errors- Wrote a MS Dynamics “connector” library to extract data (python)- Developed repo/CICD policies & processes- Worked closely with data modellers, architects and BAs to align processes/outcomes- Engineering lead on multiple data pipeline projects Show less

Melbourne, Victoria, Australia

Data engineering and data science- Worked with very large data sets (australian road traffic data), geospatial problems- Improved and rebuilt data pipelines for code quality, performance, reliability, scalability- Improved and rebuilt a machine learning pipeline - model accuracy, reduced overfit, improved scaling, distributed XGBoost- Designed an innovative bespoke geospatial matching technique for Spark with Geohash grid-based partitioning

Melbourne, Australia

BAU engineering/data science- Put a prototype industry classification model into production, with web-scraping pipelines and ongoing maintenance/refresh processes- Reviewed AWS data transformation project designs and outputs, highlighted potential issues, provided recommendations

Melbourne, Australia

Melbourne, Australia

Customer experience data scientist, and full stack software developer.- Churn modelling, XGBoost, survival analysis techniques, bespoke learned parameter investigation/interpretation- Full-stack dev - C#, TypeScript, Angular, MS Service Fabric, Event Streaming

Melbourne, Australia

Risk data analytics team. Forensic data analysis (detailed reconciliation and troubleshooting). Support tooling software developer. Data scientist