Yi Ding Email & Phone Number

San Diego, California, US

San Diego, CA, US

• Build scalable, high performance and efficient pipeline and workflows that are capable of processing billions of transactions and real-time customer activities.
• Designed and implemented data lake integration and ingestion using hadoop, pig, hive, sqoop and flume.
• Effectively used Oozie for workflow management and job scheduling.
• Designed and documented data lake security police.
• Developed PIG UDFs for manipulating the data according to Business Requirements and also worked on developing custom PIG Loaders.
• Tuning cluster and application to improve data lake performance.

San Diego, CA, US

• Setup, configuration and maintenance of a large scale Hadoop based distributed computing cluster for analytic analysis of petabytes of event data with associated metadata.
• Responsible for defining the data flow within Hadoop eco system and direct the team in implement them
• Written multiple MapReduce programs in Java for data extraction, transformation and aggregation from multiple file formats including XML, JSON, CSV and other compressed file formats.
• Developed HIVE queries for the analysts.
• Handled importing of data from various data sources, performed transformations usingHive, PIG, and loaded data into HDFS.
• Exported the analyzed data to the relational databases using HIVE for visualization and to generate reports for the BI team

San Diego, CA, US

• Worked Billing and customer, usage tracking and provisioning system development, system integration and testing using Java, C++, web service Perl and shell script.
• Developed QA automation testing tool and executed testing using perl and soupUI script.
• Implemented MediaFLO system integration QA testing and release environment. (nightly build and continue integration).
• Database upgrades and migrations. Database refresh and cloning. Oracle 10G RAC performance and loading testing and tested MediaFLO HA.
• Worked with Data warehouse development team on data warehouse data modeling and ETL Process.

US

• Worked with the overall Oracle/Sybase/MS SQL DBA on production/development environments.
• I provided 24/7 on-call support for lottery business customer’s database administration and operations in India, Singapore, Malaysia and South Africa.
• Designed and implemented Lottery center disaster and recovery solutions using Oracle Data Guard.
• Used ERWIN data modeling tools for database schema design. I also normalized and deformalized tables
• Worked on a project that migrated the company ERP system to Solomon software. I was responsible for importing/mapping the old system data to the SQL server and maintaining the running server

Reston, VA, US

• Worked on an e-business web-site development project for Rolls-Royce (www.aeromanager.com) that uses SQL server and Weblogic application servers. My responsibilities include data modeling, SQL Server database design.
• Worked on Network car project that uses oracle 8i and apache application servers to create the web-based auto-maintained eBusiness. My responsibilities included database data modeling, oracle 8i database installing and.
• Worked on a project management project that use MS Project 2000 and IIS, using Oracle database as backend
• Worked on BP data warehouse and SAIC company data warehouse projects. Performed roles of business analyst, application DBA and system architect, with full responsibility for user requirements analysis and definition.

Winnipeg, Manitoba, CA

• Administered SYBASE/ORACLE servers in HP9000 that combined on-line transaction processing and software development environment.
• Installed and upgraded Sybase Server, backup and recovery, monitored and tuned system performance, triggered and stored procedure development, and did troubleshooting t.
• Designed three-tiered Client/Server application architecture using ENTERA.
• Developed front-end PowerBuilder-designed applications (using PFC) running on Windows NT.
• Developed back end business application using C/C++ and SQL in Unix environment and the Vision Claim System, Pharmacy Claim System, Dental Claim System and Travel Health Enrollment System using Powerbuilder, Sybase.

Master Of Computer Applications (Mca)

Master Of Computer Sciences