Xiaopeng Wu Email & Phone Number

Shanghai, China

Big Data Engineer | PayPal | Shanghai, China May 2021 - Present● Established an end-to-end data processing framework integrated with Hadoop, Hive, Spark, and Airflow, initializing data pipelines and environments for PayPal’s new Chinese product, GoPay.● Designed and implemented ETL job execution tools in Java, Scala, and Shell, facilitating Spark resource management and configuration parameters, incremental data updates, and monitoring. This effort resulted in a 50% reduction in data development time and an 80% decrease in production incidents.● Led the migration of the data warehouse from Teradata and Hive to Big Query, employing and integrating specialized solutions from multiple leading technology vendors. This initiative resulted in a 30% increase in query performance and a 50% improvement in data processing efficiency.

Shanghai,China

Big Data Engineer | Ping An Health | Shanghai, China Sep 2019 - May 2021● Devised and developed an ETL automation application integrated with a scheduling system and data warehouse, resulting in a 95% reduction in effort for data development when importing data from various sources into the data warehouse. ● Created an ETL workflow to extract data from sources, transform it into a standardized format, and load it into a data warehouse for further analysis, resulting in a 60% decrease in data errors and improving overall data quality.● Built Hadoop cluster along with data warehouse and pipelines to support large-scale data processing, enhancingdata accessibility and efficiency for business insights.

Shanghai

Software Engineer | Shanghai Newtouch Software | Shanghai, China Jul 2016 - Sep 2019● Performed data platform back-end development by integrating big data components and implementing datapipelines for raw data ingestion and storage..● Utilized technologies such as Flume, Kafka, Spark, HDFS, Hive, HBase, Elasticsearch, Redis for efficient dataprocessing and management.