Xiang Yu is a Hadoop Engineer at Google at Google.
- Website:
- google.com
- Employees:
- 1
- Company phone:
- 916.253.7820
-
Hadoop EngineerGoogle Oct 2012 - PresentMountain View, Ca, Us• Maintenance and support of various underwriting reports from third party vendors • Wrote scripts to automatically Sqoop several hundreds of tables from DB2 to Hadoop. • Validated the Sqoop data against the existing data in DB2. • Wrote Pig scripts (which involved joins with the Sqoop data and also updates to the existing rows) to create accumulation tables using the feeds. • Wrote Pig Jar to obtain specific requirements that cannot be satisfied by current pig Latin. • Managing and scheduling Jobs on a Hadoop cluster using Oozie. • Responsible to manage data coming from different sources. • Installed and configured Hive and also wrote Hive UDFs. • Experience in loading and transforming of large sets of structured, semi structured and unstructured data. • Experienced in analyzing MongoDB database and compare it with other open-source NoSQL databases to find which one of them better suites the current requirements Hands on experience with NoSQL databases like HBase, Cassandra for POC (proof of concept) in storing URL's and images • Used the ETL DataStage Designer to develop processes for Extracting, Cleaning, Transforms, Integration and Loading data into data warehouse • Extensively used Sequential File Stage, Dataset Stage, File Set Stage, Lookup, Transformation and other Database plug-ins to perform transformation and load the data. • Involved in Dimensional Data Modeling (Star Schema, Snow-Flake Schema) Data Architecture, Business and Data Analysis. Environment:Hadoop in Hortonworks environment, Pig, Hive, Sqoop, HBase, IBM InfoSphereDataStage 8.7/8.5 (Manager, Designer, Director, and Administrator), Parallel Extender, DB2, Oracle, IBM Netezza, NoSQL, MongoDB, Microsoft Visio, UNIX, Windows, Mainframe -
Hadoop Developer / Technical LeadFifth Third Processing Solution May 2011 - Aug 2012Dispute processing System • Requirement analysis, design and implementation of Amex One point productfor Merchants inhighlyintegrated payment processing systems and credit card networks • Coordinate with Amex and in-housebusiness partners at different phase of SDLC • Responsible for building scalable distributed data solutions using Hadoop • Supported in setting up QA environment and updating configurations for implementing scripts with Pig, Hive and Sqoop. • Installed and configured Hive and also written Hive UDFs. • Experienced on loading and transforming of large sets of structured, semi structured and unstructured data. • Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team. • Processing Invoice and Signature capture data in DB2 database • Woked on integrated BI tools and Mainframe application Environment:Hadoop in Clouderaenvironment, Pig, Hive, Sqoop, HBase, IBM InfoSphereDataStage 8.7/8.5, DB2, Oracle, Netezza, Microsoft Visio, UNIX, Windows
-
Module Lead And Senior Software DeveloperThe Hartford Jan 2009 - Apr 2011Hartford, Ct, Us• Design and developed Rating, Risk and Change Amend of policy in a 3 tier architecture called EXCEED Architecture • Worked with ACORD XML request and responsesand MQ Tuxedo Datacommunication • Worked on COBOL/DB2/ CICS system in backend and Communication with the front end via middleware Communication Framework and XML request and responses • Interactive data communication in CICS/DB2 system with Web Services SOAP/XML • IBM InfoSphereDataStage for processing Mainframe Flat Files, DB2 data • Trained and guided team members Environment:COBOL, JCL, DB2, CICS, XML, ACCORD, IBM InfoSphereDataStage 8.7/8.5 (Manager, Designer, Director, and Administrator), Parallel Extender, DB2, UNIX, Windows
Xiang Yu Education Details
-
University Of PhoenixComputer Science
Frequently Asked Questions about Xiang Yu
What company does Xiang Yu work for?
Xiang Yu works for Google
What is Xiang Yu's role at the current company?
Xiang Yu's current role is Hadoop Engineer at Google.
What schools did Xiang Yu attend?
Xiang Yu attended University Of Phoenix.
Who are Xiang Yu's colleagues?
Xiang Yu's colleagues are Akshay Bapat, Mehedi Hasan, Latoria Pride, Xiroto Kabayashi, User1109620 Test, Basti Polter, Jeremy Frost.
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial