Abhishek Tiwari

Abhishek Tiwari Email and Phone Number

Director, Software Engineering @ LinkedIn
Mountain View, CA, US
Abhishek Tiwari's Location
Mountain View, California, United States, United States
Abhishek Tiwari's Contact Details

Abhishek Tiwari work email

Abhishek Tiwari personal email

n/a

Abhishek Tiwari phone numbers

About Abhishek Tiwari

- Leading Big Data Storage at LinkedIn. - Vice President, Gobblin at The Apache Software Foundation.Previously led compute orchestration & big data management infra at LinkedIn, worked on building an AWS service at Amazon, platform for Watson supercomputer, Hadoop infrastructure at Yahoo, analytics for bioinformatics, and full-stack web architecture at AOL.

Abhishek Tiwari's Current Company Details
LinkedIn

Linkedin

View
Director, Software Engineering
Mountain View, CA, US
Website:
linkedin.com
Employees:
23970
Abhishek Tiwari Work Experience Details
  • Linkedin
    Director, Software Engineering
    Linkedin
    Mountain View, Ca, Us
  • Linkedin
    Sr. Manager, Software Engineering
    Linkedin Sep 2021 - Present
    Sunnyvale, Ca, Us
    Managing teams responsible for building multi-exabytes Big Data Storage systems at LinkedIn, which includes: * Storage / HDFS * Space Mover * Grid Security * LinkFS / APIs * Space ServicePreviously managed teams responsible for Big Data Pipelines at LinkedIn, which includes: * Managed Airflow Service (Oklahoma) * Orchestrator for AI/ML (incl. LLM, GAI) * Pipelines Infra (Azkaban, MuFn)
  • Linkedin
    Manager, Software Engineering
    Linkedin Aug 2018 - Sep 2021
    Sunnyvale, Ca, Us
    Managed world-class cross-functional team to build and manage the Compute Orchestration Platform: Azkaban, CloudFlow, Reportal, Hadoop DSL, and Python DSL powering LinkedIn's large-scale analytics and AI workloads.Member of central Hiring Committee that reviews and approves hires for all of LinkedIn.
  • Linkedin
    Staff Software Engineer
    Linkedin Jun 2017 - Feb 2019
    Sunnyvale, Ca, Us
    Tech lead for Big Data Management Infrastructure (data processing for 200+ TB/daily, 300 Billion+ Kafka events/daily, Exabytes on HDFS) Built PaaS for big data management called GaaS (10k+ jobs for enterprise customers). Later expanded to serve several use-cases (ML model / feature transport, LinkedIn - Microsoft data pipelines, external data integrations).
  • Linkedin
    Senior Software Engineer
    Linkedin Sep 2015 - Jun 2017
    Sunnyvale, Ca, Us
    Enabled Apache Gobblin to run as elastic cluster on AWS using Apache Helix and Zookeeper. Deployed in production at several companies.Led the effort to transform LinkedIn's big data from Avro to ORC columnar format in several petabytes scale. Including schema evolution and management on the fly for thousands of datasets. Built data replication service for colo migration (550+ projects, several petabytes).
  • The Apache Software Foundation
    Vice President, Apache Gobblin
    The Apache Software Foundation Jan 2021 - Present
    Wilmington, Delaware, Us
    VP and Project Management Committee (PMC) Chair for Apache Gobblin https://www.apache.org/foundation/ https://gobblin.apache.org/
  • The Apache Software Foundation
    Pmc Member, Apache Gobblin
    The Apache Software Foundation Feb 2017 - Jan 2021
    Wilmington, Delaware, Us
    Official website: https://gobblin.apache.org/
  • Amazon Web Services
    Software Engineer
    Amazon Web Services Jun 2014 - Sep 2015
    Seattle, Wa, Us
    Engineer in Amazon AWS CloudSearch team: http://aws.amazon.com/cloudsearch/ at A9.com * Worked on storage optimization, EMR index build improvements, coordinated the engineering effort (w/ external vendors) on Apache Solr to Amazon CloudSearch migration tool* CloudWatch Integration: Wrote distributed metrics collection framework Press release: https://aws.amazon.com/about-aws/whats-new/2015/03/amazon-cloudsearch-launches-domain-performance-metrics-through-amazon-cloudwatch-and-support-for-index-field-statistics/
  • Nuance Communications
    Principal Engineer
    Nuance Communications Feb 2012 - Jun 2014
    Burlington, Ma, Us
    Worked in Mobility R&D division. * Worked on highly available architecture for Watson supercomputer DeepQA (Question-Answering) platform, and Apache UIMA pipeline powering key Nuance products* Rewrote Solr based canonicalization to make it highly configurable and scalable
  • Yahoo!
    Tech Lead
    Yahoo! Jan 2011 - Feb 2012
    Sunnyvale, Ca, Us
    Hadoop Engineering Team, CCDI - Cloud Computing and Data Infrastructure Group. * Worked on Hadoop Grid Data Management system for petabytes of data spread across multiple clusters* Worked on building data archival system to offload data from Hadoop clusters to NAS tapes, data backfill system to optimally load historical data, HCatalog integration for metadata management, distributed failover recovery, replication system, and data purging schemes
  • Eli Lilly And Company
    Software Engineer
    Eli Lilly And Company Mar 2010 - Jan 2011
    Indianapolis, Indiana, Us
    Research and Discovery of Drugs at Integrative Computational Sciences, Lilly-Singapore Centre for Drug Discovery (LSCDD)* Developed scientific tools to analyze and visualize scientific data* Abstract ICS Portal: Developed a system to help scientists explore various scientific papers and query based on genes, mesh terms, etc. * Lilly Science Grid: Developed and automated deployment system for LSG* TransXen: Wrote caching policies and tweaked visualization system
  • Aol
    Associate Software Engineer
    Aol Jun 2008 - Mar 2010
    New York, Ny, Us
    Design and development of Mobile, Personals and Job websites at AOL : - mobile.aol.com- personals.aol.com - job.aol.com * Primary developer for AOL Mobile and AOL Personals. Rewrote architecture and refactored code base of AOL Mobile and AOL Personals to achieve 99.98% uptime and sub-second page load time* Helped in AOL Shopping redesign, wrote various API integrations and helped build Taxonomy management system * Wrote analytics in Hive for AOL Personals including several UDFs
  • Yodlee Infotech Pvt Ltd
    Intern
    Yodlee Infotech Pvt Ltd Jun 2007 - Aug 2007
    Redwood City, Ca, Us
    Worked in the Core Platform development team on the development of the SLA Infrastructure.
  • Freelancer
    Freelancer
    Freelancer Aug 2005 - Aug 2006
    Worked as a freelancer on several projects (LAMP based web development, etc.)

Abhishek Tiwari Education Details

  • Dr. A.P.J. Abdul Kalam Technical University
    Dr. A.P.J. Abdul Kalam Technical University
    Computer Science And Engineering

Frequently Asked Questions about Abhishek Tiwari

What company does Abhishek Tiwari work for?

Abhishek Tiwari works for Linkedin

What is Abhishek Tiwari's role at the current company?

Abhishek Tiwari's current role is Director, Software Engineering.

What is Abhishek Tiwari's email address?

Abhishek Tiwari's email address is ab****@****din.com

What is Abhishek Tiwari's direct phone number?

Abhishek Tiwari's direct phone number is +197880*****

What schools did Abhishek Tiwari attend?

Abhishek Tiwari attended Dr. A.p.j. Abdul Kalam Technical University.

Who are Abhishek Tiwari's colleagues?

Abhishek Tiwari's colleagues are Johnsvmvu0930-132345 Doe, Randy Morton, Johnsfovx0804-180416 Doe, Cornelius Muthui, Turane Eliyeva, Leonela Bruno, User1 Test_359696.

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Aero Online

Your AI prospecting assistant

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.