Abhishek Tiwari Email & Phone Number

Mountain View, Ca, Us

Sunnyvale, Ca, Us

Managing teams responsible for building multi-exabytes Big Data Storage systems at LinkedIn, which includes: * Storage / HDFS * Space Mover * Grid Security * LinkFS / APIs * Space ServicePreviously managed teams responsible for Big Data Pipelines at LinkedIn, which includes: * Managed Airflow Service (Oklahoma) * Orchestrator for AI/ML (incl. LLM, GAI) * Pipelines Infra (Azkaban, MuFn)

Sunnyvale, Ca, Us

Managed world-class cross-functional team to build and manage the Compute Orchestration Platform: Azkaban, CloudFlow, Reportal, Hadoop DSL, and Python DSL powering LinkedIn's large-scale analytics and AI workloads.Member of central Hiring Committee that reviews and approves hires for all of LinkedIn.

Sunnyvale, Ca, Us

Tech lead for Big Data Management Infrastructure (data processing for 200+ TB/daily, 300 Billion+ Kafka events/daily, Exabytes on HDFS) Built PaaS for big data management called GaaS (10k+ jobs for enterprise customers). Later expanded to serve several use-cases (ML model / feature transport, LinkedIn - Microsoft data pipelines, external data integrations).

Sunnyvale, Ca, Us

Enabled Apache Gobblin to run as elastic cluster on AWS using Apache Helix and Zookeeper. Deployed in production at several companies.Led the effort to transform LinkedIn's big data from Avro to ORC columnar format in several petabytes scale. Including schema evolution and management on the fly for thousands of datasets. Built data replication service for colo migration (550+ projects, several petabytes).

Wilmington, Delaware, Us

VP and Project Management Committee (PMC) Chair for Apache Gobblin https://www.apache.org/foundation/ https://gobblin.apache.org/

Wilmington, Delaware, Us

Official website: https://gobblin.apache.org/

Seattle, Wa, Us

Engineer in Amazon AWS CloudSearch team: http://aws.amazon.com/cloudsearch/ at A9.com * Worked on storage optimization, EMR index build improvements, coordinated the engineering effort (w/ external vendors) on Apache Solr to Amazon CloudSearch migration tool* CloudWatch Integration: Wrote distributed metrics collection framework Press release: https://aws.amazon.com/about-aws/whats-new/2015/03/amazon-cloudsearch-launches-domain-performance-metrics-through-amazon-cloudwatch-and-support-for-index-field-statistics/

Burlington, Ma, Us

Worked in Mobility R&D division. * Worked on highly available architecture for Watson supercomputer DeepQA (Question-Answering) platform, and Apache UIMA pipeline powering key Nuance products* Rewrote Solr based canonicalization to make it highly configurable and scalable

Sunnyvale, Ca, Us

Hadoop Engineering Team, CCDI - Cloud Computing and Data Infrastructure Group. * Worked on Hadoop Grid Data Management system for petabytes of data spread across multiple clusters* Worked on building data archival system to offload data from Hadoop clusters to NAS tapes, data backfill system to optimally load historical data, HCatalog integration for metadata management, distributed failover recovery, replication system, and data purging schemes

Indianapolis, Indiana, Us

Research and Discovery of Drugs at Integrative Computational Sciences, Lilly-Singapore Centre for Drug Discovery (LSCDD)* Developed scientific tools to analyze and visualize scientific data* Abstract ICS Portal: Developed a system to help scientists explore various scientific papers and query based on genes, mesh terms, etc. * Lilly Science Grid: Developed and automated deployment system for LSG* TransXen: Wrote caching policies and tweaked visualization system

New York, Ny, Us

Design and development of Mobile, Personals and Job websites at AOL : - mobile.aol.com- personals.aol.com - job.aol.com * Primary developer for AOL Mobile and AOL Personals. Rewrote architecture and refactored code base of AOL Mobile and AOL Personals to achieve 99.98% uptime and sub-second page load time* Helped in AOL Shopping redesign, wrote various API integrations and helped build Taxonomy management system * Wrote analytics in Hive for AOL Personals including several UDFs

Redwood City, Ca, Us

Worked in the Core Platform development team on the development of the SLA Infrastructure.

Worked as a freelancer on several projects (LAMP based web development, etc.)