Xiang Yu

Xiang Yu Email and Phone Number

Hadoop Engineer at Google @ Google
Mountain View, CA
Xiang Yu's Location
Mountain View, California, United States, United States
About Xiang Yu

Xiang Yu is a Hadoop Engineer at Google at Google.

Xiang Yu's Current Company Details
Google

Google

View
Hadoop Engineer at Google
Mountain View, CA
Website:
google.com
Employees:
1
Company phone:
916.253.7820
Xiang Yu Work Experience Details
  • Google
    Hadoop Engineer
    Google Oct 2012 - Present
    Mountain View, Ca, Us
    • Maintenance and support of various underwriting reports from third party vendors • Wrote scripts to automatically Sqoop several hundreds of tables from DB2 to Hadoop. • Validated the Sqoop data against the existing data in DB2. • Wrote Pig scripts (which involved joins with the Sqoop data and also updates to the existing rows) to create accumulation tables using the feeds. • Wrote Pig Jar to obtain specific requirements that cannot be satisfied by current pig Latin. • Managing and scheduling Jobs on a Hadoop cluster using Oozie. • Responsible to manage data coming from different sources. • Installed and configured Hive and also wrote Hive UDFs. • Experience in loading and transforming of large sets of structured, semi structured and unstructured data. • Experienced in analyzing MongoDB database and compare it with other open-source NoSQL databases to find which one of them better suites the current requirements Hands on experience with NoSQL databases like HBase, Cassandra for POC (proof of concept) in storing URL's and images • Used the ETL DataStage Designer to develop processes for Extracting, Cleaning, Transforms, Integration and Loading data into data warehouse • Extensively used Sequential File Stage, Dataset Stage, File Set Stage, Lookup, Transformation and other Database plug-ins to perform transformation and load the data. • Involved in Dimensional Data Modeling (Star Schema, Snow-Flake Schema) Data Architecture, Business and Data Analysis. Environment:Hadoop in Hortonworks environment, Pig, Hive, Sqoop, HBase, IBM InfoSphereDataStage 8.7/8.5 (Manager, Designer, Director, and Administrator), Parallel Extender, DB2, Oracle, IBM Netezza, NoSQL, MongoDB, Microsoft Visio, UNIX, Windows, Mainframe
  • Fifth Third Processing Solution
    Hadoop Developer / Technical Lead
    Fifth Third Processing Solution May 2011 - Aug 2012
    Dispute processing System • Requirement analysis, design and implementation of Amex One point productfor Merchants inhighlyintegrated payment processing systems and credit card networks • Coordinate with Amex and in-housebusiness partners at different phase of SDLC • Responsible for building scalable distributed data solutions using Hadoop • Supported in setting up QA environment and updating configurations for implementing scripts with Pig, Hive and Sqoop. • Installed and configured Hive and also written Hive UDFs. • Experienced on loading and transforming of large sets of structured, semi structured and unstructured data. • Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team. • Processing Invoice and Signature capture data in DB2 database • Woked on integrated BI tools and Mainframe application Environment:Hadoop in Clouderaenvironment, Pig, Hive, Sqoop, HBase, IBM InfoSphereDataStage 8.7/8.5, DB2, Oracle, Netezza, Microsoft Visio, UNIX, Windows
  • The Hartford
    Module Lead And Senior Software Developer
    The Hartford Jan 2009 - Apr 2011
    Hartford, Ct, Us
    • Design and developed Rating, Risk and Change Amend of policy in a 3 tier architecture called EXCEED Architecture • Worked with ACORD XML request and responsesand MQ Tuxedo Datacommunication • Worked on COBOL/DB2/ CICS system in backend and Communication with the front end via middleware Communication Framework and XML request and responses • Interactive data communication in CICS/DB2 system with Web Services SOAP/XML • IBM InfoSphereDataStage for processing Mainframe Flat Files, DB2 data • Trained and guided team members Environment:COBOL, JCL, DB2, CICS, XML, ACCORD, IBM InfoSphereDataStage 8.7/8.5 (Manager, Designer, Director, and Administrator), Parallel Extender, DB2, UNIX, Windows

Xiang Yu Education Details

  • University Of Phoenix
    University Of Phoenix
    Computer Science

Frequently Asked Questions about Xiang Yu

What company does Xiang Yu work for?

Xiang Yu works for Google

What is Xiang Yu's role at the current company?

Xiang Yu's current role is Hadoop Engineer at Google.

What schools did Xiang Yu attend?

Xiang Yu attended University Of Phoenix.

Who are Xiang Yu's colleagues?

Xiang Yu's colleagues are Akshay Bapat, Mehedi Hasan, Latoria Pride, Xiroto Kabayashi, User1109620 Test, Basti Polter, Jeremy Frost.

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Aero Online

Your AI prospecting assistant

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.