Manager, Data Engineering, Reporting & Analytics, DevOps for home services marketplace.• Manage team of 10-12, comprising data engineers, devops engineers and data analysts.• Participate and collaborate in prioritization meetings with business stakeholders.• Define and manage SLAs for all data sets/data pipelines.• Define processes, best practices to deploy and manage 150-200 workloads to Kubernetes in GKE. • Championed and designed a data governance application for managing metadata.• Design & build a data lake in GCP BigQuery with data from 10+ different sources.• Build an end to end supply-demand solution for home services marketplace.• Enable ~50 data sets with metadata for data analysts/scientists. Pipelines include multi GBclickstream data from Mixpanel written in Golang• Build a near real time, in-flight data processing pipeline in Golang, from OLTP databases to datalakes, by using Kafka to capture events.• Design and build Kubernetes objects (statefulsets, deployments, cronjobs) using Kustomize.Technologies:• Python, Golang, MySQL, AWS Redshift, Postgres, Ansible, Docker, Kafka, Kubernetes in GKE, BigQuery, GCP, Jenkins.

Data Engineer• Built data pipelines for data analysts/scientists using python, vertica and hive.• Pipelines included multi GB internal clickstream, impression sources as well as third party sourceslike Acuity, Attune, Appsflyer, Facebook, Google (SEM) for marketing/operational purposes.Technologies:• Python 2.7, MySQL, Vertica, Hive, Sqoop, Flume, Kafka, Jenkins.

Team lead of data team for marketplace, PIM (product information management) systems.• Led a team of 3-4 data engineers.• Hired, mentored offshore team in Pune, India.• Collaborated with the application team to establish contracts to integrate the data APIs.• Participated and collaborated in prioritization meetings with business stakeholders. Major Deliverables.• Performed Data modeling, created ER Diagrams and designed application data flows for datadomains for a retail marketplace system (catalog, account management, OMS, users).• Implemented a custom sharding solution using MySQL (30+ shards) to hold multi TBmerchandising catalog.• Designed and built stored procedures in MySQL to expose data as a service to the application.• Introduced and adopted Hadoop, Hive to the ecosystem.• Designed a data pipeline from MySQL to Hadoop using Sqoop and hive to perform aggregationsof data and then exported it back to MySQL for reporting needs.• Performance tuning of SQL that resulted in reduction of response time.Technologies:• MySQL, DB2, Datastage, shell scripting, Subversion, git, Hadoop (hive), Sqoop

Reporting Analyst in blockbuster online business.• Developed reports using crystal reports, comprising KPIs for Finance & Accounting, DC Operations, Marketing & Analytics, Customer Service, Product Procurement and Digital Delivery departments.• Coded and tested ETL jobs in PL/SQL in Oracle 9i• Built data marts and aggregate tables for super users.• Performed SQL tuning using oracle hints, indexes, analytical functions, table partitions• Performed user acceptance testing of reports.• Crystal Enterprise admin activities - installation, managing and organizing reporting structures,users, and server groups• Designed a ticketing system for production support purposes.• Onsite- offshore coordination.Technology:• Windows 2003; IIS 6.0, Crystal Reports 10, Crystal Enterprise 10, Business Objects Enterprise X1R2, Oracle 9i/10g, SQL Server 2000/2005