Shaobin Du Email & Phone Number

Palo Alto, Ca, Us

- Oversee data security, management and storage efficiency- Research ways the company's technological assets can be improved, ensuring technologies currently in use are efficient and making changes wherever necessary- Oversee the preparation and final approval of project plans; conducts cost analysis for development projects; ensures that projects are completed within budget and in an economical manner.- Ensure that departmental decisions such as staffing, development, organization, and facilities are in line with the organizations business plan and vision.

Palo Alto, Ca, Us

* Led the development of Curated Data Platform to build both online users' predictive and Psychographics datasets, process and build daily feeds* Built and enhanced data ingestion pipelines to process billions of events per day* Built and managed scheduling and monitoring workflow platform

Santa Clara, California, Us

Architect and co-develop Bigdata-based Data lake and analytics platform for Manufacturing and IoT data acquisition and analytics

Sunnyvale, California, Us

Architect and develop cutting edge AWS cloud-based search infrastructure that achieves scale, speed and reliability for threat analytics teams

Toronto, Ontario, Ca

Leading the effort of architecting and developing Sysomos Big Data Intelligence Analytics Platform based on Spark and Yarn to process large scale of social media contents. In addition, designed and developed several NLP(Natural Language Processing) Restful services via integrating with machine learning algorithms, and developed a few applications including a spark streaming orchestration to be run on the platform.Technologies include: Hadoop/HDFS/Yarn, Spark, Kafka, Solr, HBase, MongoDB, Flume, JPA, and OpenNLPMeanwhile, also led a group of talented engineers to work on Sysomos social content vertical crawler to crawl contents from News, blog and forum sites. Technologies include: Hadoop/HDFS, HBase, Kafka and Redis

San Jose, Ca, Us

Led a team of 10 talented engineers responsible for the following products:1). Open Intel Platform - Responsible for the full life-cycle of the platform which orchestrates third-party intelligence signals within Threatmetrix platform to enhance fraud prevention and enterprisewide authentication. Involved in overall lifecycle of the product and communications. Technologies include: Apache Camel, Cassandra, Zookeeper, JSF andThrift(http://www.banklesstimes.com/2016/09/12/threatmetrix-enjoying-strong-year/)2). Data Warehouse - Next Generation of Data Warehouse on top of Cloudera Impala, HDFS and Kafka. Technologies include: Kafka, Hadoop/HDFS, Impala, Zookeeper, Oozie and Thrift.3). SmartID - A ML based fraud prevention product to conduct device identification via fuzzy device matching model which is based on the shared intelligence across different customers. Technologies include: Datastax Search (Solr and Cassandra) and K-Mean4). Variable(Feature) Generation Framework (VGF) - to generate feature specification for Threatmetrix Smart Analytics Services. Technologies include: Storm and JSF5). Other products including CBA and Greenplum data Warehouse.

Austin, Texas, Us

Us

Hyperion is acquired by Oracle in 2007.

Us

Chicago, Illinois, Us

Computer & Information Science & Engineering

Phd Candidate, Physical Chemistry