Eric Liu Email & Phone Number

Victoria, Australia

Australia

• Participated in end-to-end data solutions development, from web scraping, data warehousing, cleansing, modeling, and API building.• Developed automated data pipeline of millions of product information records from leading ecommerce platforms.• Applied algorithms and create indexes for efficient data search capabilities.• Utilize a verity of software throughout the process, such as Python, Google Cloud Storage, BigQuery, DBT andOpenSearch.• Continuous communications, design… Show more • Participated in end-to-end data solutions development, from web scraping, data warehousing, cleansing, modeling, and API building.• Developed automated data pipeline of millions of product information records from leading ecommerce platforms.• Applied algorithms and create indexes for efficient data search capabilities.• Utilize a verity of software throughout the process, such as Python, Google Cloud Storage, BigQuery, DBT andOpenSearch.• Continuous communications, design and add new features to the data pipeline according to user needs.Received very good feedback from users saying the product is fast, robust, and reliable. Show less

Guangdong, China

• Spearheaded the design and deployment of a scalable data processing platform, enhancing data throughput by 300%. Worked with a cross-functional team in the development of a predictive analytics model that reduced operational costs by 20%.• Architected and implemented a real-time data ingestion system using Kafka, improving data availability and reliability.• Automated ETL pipelines in AWS cloud environment, leveraging Python and Spark, which streamlined data workflows… Show more • Spearheaded the design and deployment of a scalable data processing platform, enhancing data throughput by 300%. Worked with a cross-functional team in the development of a predictive analytics model that reduced operational costs by 20%.• Architected and implemented a real-time data ingestion system using Kafka, improving data availability and reliability.• Automated ETL pipelines in AWS cloud environment, leveraging Python and Spark, which streamlined data workflows and reduced processing time by 50%.• Enhanced data cluster management with Hadoop, significantly improving system efficiency and stability.• Developed an intuitive ELK stack-based data visualization platform, which led to a 40% increase in user engagement.• Optimized SQL database performance, achieving a 25% reduction in query response times.• Conducted in-depth data analysis and modelling, contributing to the development of a customer behaviour prediction tool that increased sales leads by 30%.|Key Projects• Distributed Data Processing SystemDeveloped a distributed system for processing IoT sensor data, using Apache Spark and Hadoop, which processed terabytes of data daily, enhancing data-driven decision-making for smart city applications.• Real-Time Analytics DashboardCreated a real-time analytics dashboard for e-commerce platforms, employing Python and Spark Streaming. The solution provided insights into customer behaviour, increasing conversion rates by 15%. • Data Warehouse OptimizationLed the optimization of a data warehousing solution for a multinational corporation, employing advanced ETL techniques and data modelling, which improved data query performance by over 35%. Show less

Master, Information Technology, 77

Data Modeling/Warehousing And Database Administration

Master Of Data Science, Information Technology, 74

Bachelor Of Engineering - Be, Information Technology, 80