Thet Ko work email
- Valid
- Valid
- Valid
Thet Ko personal email
I am an independent thinker that specialises in delivering technical solutions on greenfield projects. With 10+ years experience working across the full stack from cloud infrastructure, databases, backend systems to front end development, I have helped organisations like Seek, TechnologyOne and the University of Queensland achieve big data and integration capabilities. My Achievements:- Advanced DataOps maturity at Seek by leading the rollout of Databricks and onboarding over 170 Data scientists and engineers- Led a high performance team of 8 delivering platforms for Seek AI division- Designed, developed and implemented UQ's Big data self-service platform.- Development and implementation of UQ's central integration platform.- Designed and engineered GO1/Aduro LMS, 2013/2014 Best New Coming Learning Management System- Established a development team in Vietnam consisting of over 20 developersMy Mantra:- Build for the future:++ The system should adapt to future changes in technologies, approaches and ideas. (Modular & Microservices)++ The system should scale to load and usage requirements. (Horizontal Scaling and cloud infrastructure)- Fail Fast:++ Delivering the optimal solution is sometimes only possible after the learnings of failed attempts. Being able to quickly learn and adapt approaches leads to better outcomes with less technical debt.- Short / Long term harmony:++ Short term solutions should complement and form part of the long term goals. - Do not re-invent the wheel++ Integrating opensource software and cloud services reduces time to market and system maintenance.- Be comfortable with the unknown++ It is usually in the unknown where new ideas, approaches and technologies are discovered. My Technology stacks:- CloudNative: Kubernetes / Docker- Cloud: AWS and associated services- Big Data: Databricks, AWS Glue, Athena, Lakeformation, Apache Spark, Jupyter Notebook, Kubeflow, Apache Airflow, Apache Hudi- AI/ML: Huggingface, Langchain, MLFlow- BI Visualisation: Apache Superset- Stream Processing: Attunity CDC / Kafka / Kinesis - Coding: GoLang, Javascript, Python, Java, Scala, PHP- CI: Jenkins, Ansible, Teamcity, Buildkite- Frameworks: Symfony, Spring IO, Django, React, Drupal- Modelling: XSD, Swagger, Json Schema, XSLT, Xquery- Database: Oracle, Mysql, MongoDB, Neo4j, Elasticsearch, DynamoDB, Athena, Snowflake- VCS: Git- IAC: Terraform, Cloudformation- IDP: Okta
-
Engineering ManagerSeek Jan 2023 - PresentCremorne, Victoria, AuLed a high-performing platforms team comprising 8 engineers, driving advancements in DataOps and MLOps within Seek AI division. Led the development and roll out of critical platforms supporting data scientists and the experimentation team, including:1. Implementation of an events ingestion platform capable of processing over 8k req/sec, supporting both batch and near real-time use cases. This platform facilitated data capture from diverse sources, enhancing analytics and experimentation capabilities across Seek.2. Successful rollout of Databricks throughout Seek AI Division, accompanied by extensive training to empower analysts, data scientists, and engineers with best practices in big data and ml.3. Development of a scalable and customizable experimentation engine, integral to conducting data processing and analysis for experimentation initiatives at Seek. -
Principal EngineerSeek Jan 2022 - Jan 2023Cremorne, Victoria, AuResponsible for the successful roll out of Databricks across Seek AI Division. - Onboarded over 170 data scientists, data engineers and analysts- Improved end to end data pipelines using terraform, pyspark and gitflow.- Implemented security controls to limit data exfiltration and reduce security vulnerabilities- Trained up and led a team of engineers to provide Databricks related support for Seek
-
Lead Data EngineerTechnologyone Jan 2021 - Jan 2022Fortitude Valley, Qld, AuResponsible for designing and implementing the data platform to realise Technology One’s new initiative in becoming a data driven company. The cloud native data analytics platform empowers users, analysts, data scientists across the organisation to easily find, query and process the data through a scalable and secure system. - Unified security and governance across all data accessible channels from api calls, jdbc / odbc connections through to web and namespaced etl processing. - Automated metadata gathering and publishing to the central data catalog on Amundsen.- Designed and implemented the CICD workflows and patterns utilising terraform, makefiles and teamcity.- Improved visibility and governance across the organisation by centralising and providing cloudtrail and cloudfront data using apache HUDI for low cadence/optimised querying.- Reduced s3 costs by $10000+ a month by processing billions of legacy s3 files and rewriting it in columnar format.- Realised cost savings from migrating data and workloads from redshift to Athena.- Cost optimisation of ec2 and RI instances by providing an hourly snapshot of ec2s across hundreds of accounts each over 21 regions.- Cost optimisation of data workloads by utilising cloud native architecture and spot instances.- Reduced barrier to data with SSO access to Amundsen and Superset.- Supported compliance initiatives through configurable alerting and reporting capabilities. -
Lead Data EngineerThe University Of Queensland Jul 2018 - Jan 2021Brisbane, Queensland, AuDesigned, developed, and implemented Big Data as a Service for the university, simplifying end-to-end big data analysis and promoting self-service workflows. Tailored service, enabling users to easily and safely consume, query, analyse, and publish insights, avoiding setup, security, scaling and resourcing complexities. Administered student engagement analysis, space optimization through Wi-Fi analysis, and application processing machine learning models. Exceeded university’s expectations by simplifying data ingestion (Attunity CDC, S3 event triggering, Kinesis, Kafka streams, API scraping) and analytics (Jupyter notebook instances, spark clustering, MPP database querying capabilities), reducing operational costs, and facilitating workshops on best practices. Reduced onboarding time of new users and external contractors from days to minutes. - Curated and aggregated complex datasets consisting of over 4 billion rows (Apache Spark). - Created usage and governance dashboards on AWS quicksight.- Enhanced scaling performance and parallel job processing at reduced cost (Apache Spark on Kubernetes).- Automated data pipelines on Apache Airflow and set up cluster monitoring through Prometheus.- Implemented Single Sign-on for BDAAS platform to Enterprise AD through SAML.- Optimised cost of operation, utilising proven opensource software, spot instances and cloud native architecture and technologies.- Streamlined data search and request approvals through a custom developed datacatalog leveraging AWS Glue, Athena and Lakeformation.- Simplified AI/ML with H2O on spark. -
Lead Integration DeveloperThe University Of Queensland Sep 2016 - Jul 2018Brisbane, Queensland, AuDeveloped and implemented Central Integration Platform, centralizing rest API service for developers and applications. Enhanced API standardization, integration maintainability, and time-to-market of new applications. Applied data integration methodologies and created infrastructure deployment strategies, augmenting availability and scalability. - Deployed over 100 domain centric APIs used across university. - Serviced more than 500 000 API calls daily across two nodes.
-
Web Team LeaderThe University Of Queensland Feb 2016 - Sep 2016Brisbane, Queensland, AuLed team to transition web applications from legacy systems to centralized platform. Attended stakeholder meetings and partook in staff recruitment. Communicated and delegated requirements and tasks to the team, ensuring timely and quality delivery. - Coordinated migration of over 30 legacy websites to Drupal.
-
Senior DeveloperThe University Of Queensland Apr 2015 - Feb 2016Brisbane, Queensland, AuDeveloped and launched website and rest web services. Modelled university-specific entities such as Programs, Staff, and Majors through XSD. Provided foundations for data sharing across applications. Ensured Elasticsearch integration to allow for complex querying and filtering of program data.- Enhanced filtering and result ordering, providing greater power and flexibility. - Launched new Future Students Website with contextual content based on user region and reusable components.
-
Contract DeveloperCromwell Property Group Jan 2015 - Apr 2015Brisbane City, Queensland, AuAngular JS investor portal interfacing with .Net backend.- Responsive design implementation- Web service consumption- Authentication / Authorization -
Development ManagerGo1 Jan 2012 - Jan 2015Brisbane, Qld, AuManaged development team to create Aduro LMS (named top 15 learning management platform) for use by corporates, RTOs and government. Strategized product roadmap according to client feedback and future market trends, applying agile methodology to product trajectory from sprint planning to release. Consulted team and management on technologies, development processes, and best practice. Administered technical solutions to requirements in RFP’s and pre-sales. - Customized product as SaaS offering, enabling easy redeployment for new customers.- Ensured scalability and extensibility by proposing and managing technical architecture of solutions. -
Technical Project ManagerGo1 Jan 2010 - Jan 2012Brisbane, Qld, AuOrchestrated technical projects to solve business requirements, liaising with project stakeholders, management, and technical teams to define and deliver requirements. Scoped and documented business process flows, user acceptance testing, and estimated project milestones. - Supervised technical teams of more than 10 people, using agile and waterfall methodologies to deliver projects.
-
Lead DeveloperGo1 2009 - 2010Brisbane, Qld, AuSupervised development, setting guidelines, reviewing code, and ensuring compliance with coding standards and best practices. Oversaw continuous integration across large scale applications and maintained high test coverage across code. Trained team members and users, consulted on Drupal, and developed custom modules.
Thet Ko Skills
Thet Ko Education Details
-
QutElectrical And Computer Engineering -
QutManagement And Banking And Finance
Frequently Asked Questions about Thet Ko
What company does Thet Ko work for?
Thet Ko works for Seek
What is Thet Ko's role at the current company?
Thet Ko's current role is Engineer.
What is Thet Ko's email address?
Thet Ko's email address is th****@****.com.au
What schools did Thet Ko attend?
Thet Ko attended Qut, Qut.
What skills is Thet Ko known for?
Thet Ko has skills like Php, Drupal, Web Development, Css, Html, Agile Methodologies, Web Project Management, Project Management, Javascript, Git, Oop, Mysql.
Free Chrome Extension
Find emails, phones & company data instantly
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial