Good at system construction of offline and real-time data warehouseGood at the construction of middle-office tool system, including data integration, metadata management, data quality DQC, data service, etc.Good at data and application team building and managementHave a certain product Sense, have more experience and interest in data empowerment business

Good at system construction of offline and real-time data warehouseGood at the construction of middle-office tool system, including data integration, metadata management, data quality DQC, data service, etc.Good at data and application team building and managementHave a certain product Sense, have more experience and interest in data empowerment business

- Building data warehouse(ODS, DWD, DWS and ADS) with hive, airflow, spark(spark sql) etc. Meet the data analysis needs of the business, turn the data into information and value.- Building real-time calculation from zero to one with Kafka and Spark Streaming, the main scenarios include real-time indicator calculation, business monitoring, and real-time data ETL.- Building data governance products including metadata platform(data life cycle, blood relation), data quality center.- Building user behavior event tracking system with model, process and platform, improve data analysis accuracy and reduce data analysis costs.

Building a data warehouse based on a layer model.Building data ETL for business data requirements.Building user profile, crowd system, operation and analysis platform for markingCompute a simple real-time computing platform based on HBase and Metaq.Some system application development work.

Data migration from Mysql to HDFS to Hive;Data ETL(Extract, Transform and Load);Developed computational model with HQL;Scheduling of dependent tasks system；Developed back-end for web site with yii and Django;

Developed directional crawler system with selenium; Build RFM model to classify users for some activity scenario；Buy path analysis with users' log data using HQL;Developed BI system with Spring and Mybatis.

Developed architecture platform and testing tools for supporting product testing, familiar with selenium, jenkins and rundeck.