Bigdata Olap Platform Engineering
Current1, Responsible for high availability ClickHouse cluster construction and storage optimization, real-time data warehouse construction;2, Build robust and cutting-edge big data platforms for realtime processing and machine learning of TB level data sets from kinds of cloud-based robotics;3, Develop data processing pipelines for ingestion, modelling, analysis, mining and reporting with SQL, Spark, Flink, etc;4, Solve technical challenges posted to the big data platform from huge volume, realtime velocity and sensitivity classification of incoming data;5, Collaborate with operation team and Data Science team for data engineering support and development/deployment of BI reporting and data models;