Zack Shapiro Email & Phone Number

Alameda, Ca, Us

San Francisco, California, Us

* Grew team to 14* Designed and led PII handling for our Data lake/warehouse. This included a year-long migration to a compliant data lake/warehouse.* Designed and led the development of a hybrid batch and streaming DB synchronization solution.* Led a company-wide migration from one data platform vendor, Qubole, to Databricks. This included working with third party professional services, as well as in-house teams across analytics and proddev to seamlessly migrate data and workloads to spark. * Led development of experimentation platform* Managed $10M+ annual data budget across AI org and proddev. Focused on cost transparency to empower responsible utilization of data.

San Francisco, California, Us

* Stabilized existing data infrastructure on custom ETL and Redshift* Introduced Airflow and Data Lake, re-wrote batch event-ingestion, database ingestion and completely replaced custom ETL.* Designed and implemented a platform for building and deploying ETL jobs with only SQL knowledge with pluggable sources and sinks(similar to DBT, which was not available). This now runs over 3k pipelines, running 80k+ daily tasks.* Designed and led a production service for low-latency use of pre-aggregated datasets.* Replaced Redshift with Lake-house architecture.

San Francisco, California, Us

San Francisco, California, Us

Responsible for the analytics and infrastructure engineering teams. - Led the engineering team through a complete re-write of the infrastructure from Java to CSharp/.NET.- Designed a system to match patterns in strongly-typed event streams, and feed the results back to a data warehouse, or to optimize a decision tree. - Built, and managed the building of ETL processes, OLAP cubes and reporting.- Designed and built a near-real-time aggregation system for populating OLAP cubes on the fly. A Java-based query layer with a REST API is used to access and display the data on a Groovy on Grails and Javascript dashboard.- Built a high-availability, real-time aggregation framework for multi-dimensional and tree-based data sources.- Implemented Hadoop/Hive-based system for asynchronous processing of raw data.- Built a Java-based near-real-time call-tree performance analysis dashboard for the entire hi5 infrastructure in aggregate. This is used to rapidly identify system performance bottlenecks.- Built the data collection and aggregation, monitoring systems, and automated rate limiting for our Open Social API.- Built Hi5's ad server. A rules engine and content injection system which matched rules and interpreted JSTL and EL in <2ms roughly 4B times a day.

Us

- Responsible for gathering client requirements, designing and implementing solutions for key customers.- Responsible for global web application and database operations and architecture for Moody’s KMV including 15+ web applications, 22TB+ of data, and 100+ servers.- Designed and implemented high-availability and disaster recovery for mission-critical services. Utilizing database replication, log shipping, clustering and load balancing.- Created cost and pricing models for web applications.- Designed and implemented capacity forecasting tools and alerts.- Responsible for SAS70 audit and certification.- Managed the consolidation of 5 data centers and over 400 servers into a single, cost-saving, datacenter. Project included various vendors and subcontractors and was completed on time, with minimal service disruption and $1M under-budget.- Negotiated software contracts, saving as much as 68% on some contracts.

Us

- Led a team of engineers responsible for J2EE and .NET web applications and services and Sybase and SQL Server databases. Designed and developed tools, build and release automation, performance tuning and high-availability solutions. - Interfaced with product management, QA, content providers and application development.- Implemented post mortem and change control process workflows.- Implemented single sign on across multiple products, using SiteMinder and ActiveDirectory.- Designed and implemented high-availability and disaster recovery for mission-critical services.- Managed customer relationships and led client implementations.- Reduced annual server hosting costs $1M+ by in-sourcing and consolidating servers.

Us

- Designed and implemented a common build and release infrastructure for all web applications and databases.- Centralized build and release processes.- Designed and implemented health and availability dashboard utilizing Java and open source data and graphing libraries.- Implemented content management solution for corporate websites.

Us