John Souza Email & Phone Number

San Francisco, Ca, Us

I lead a team of data engineers and analytics engineers specializing in four key areas: cloud cost, location/geography, traffic, and bots. These domains necessitate meticulous coordination and alignment across the entire company. The insights derived from our data are pivotal in shaping strategic decisions in sales, marketing, policy, and compute architecture.

San Francisco, Ca, Us

As the sole Senior Staff Data Engineer in the Users, Listings, and Platforms organization, I was responsible for a diverse array of critical tasks:- Context Setting: I ensured the quality and consistency of our offline data models by building and maintaining an in-depth understanding of various projects and technical changes across the organization.- Technical Leadership: I architected and led the technical design and implementation of several AI/ML-based product features, including Airbnb Categories, Photo Tour, and Listing Quality Score.- Data Strategy: I developed long-term data architecture proposals and provided recommendations to support near-real-time processing, offline-to-online data flows, and AI/ML product features.- Data Architecture: I oversaw 35 of the company's top 130 offline data models, which are essential for business operations, internal reporting, and external reporting. These models included listings, experiences, hosts, availability, pricing, and unit economics.- Standardization Efforts: I participated in and led the Data Architecture Working Group, a virtual team of data architects responsible for setting standards for data quality and data modeling across the company.

Cupertino, California, Us

I served in various capacities as both an individual contributor and engineering manager. My primary focus was on developing and maintaining data pipelines that were essential for machine learning teams to enhance the models powering Siri. These training datasets were pivotal in enabling Siri's on-device functionality, a groundbreaking feature at the time. My team spearheaded this initiative within an innovative hybrid infrastructure, integrating legacy on-premise data centers with cutting-edge cloud-based resources.

Los Gatos, Ca, Us

General Responsibilities: - Work closely with a wide variety of stakeholders to gather business requirements and translate them in to technical requirements, data models, and/or ETL pipelines. - Build and maintain ETL pipelines in Netflix's cloud-based big data platform using tools like Pig, Hive, Presto, Spark, Druid. - Develop and maintain custom business logic written in a wide variety of programming languages (Java, Python, etc.).Streaming Playback Responsibilities: - Remodel playback logging datasets to reduce storage costs, simplify usage, and decrease data latency. Re-wrote old data pipelines originally written in Pig using Spark (PySpark & Scala).Studio Data Responsibilities: - Design, develop, and maintain ETL building core datasets used by several technical and non-technical teams. Datasets include content delivery, content quality, media encoding, and predictive modeling for content decisions.A/B Experimentation Responsibilities: - Design, develop, and maintain ETL building datasets and reports that determine the results of 1000s of A/B tests (trillions of rows; petabytes of data). - Developed custom DAG scheduling software automating the prioritization, scheduling, and execution of ETL for A/B tests. The framework quantifies the priority of data and optimizes processing on under-utilized compute resources to minimize costs while maintaining SLAs. - Pioneered the use of Druid as a low-latency distributed OLAP query engine to support Netflix's internal web-based UI visualizing the results of A/B experiments. Client Logging Responsibilities: - Design, develop, and maintain ETL aggregating client logging generated by all Netflix apps and devices. - Developed highly optimized data-flow logic that incrementally sessionizes over 300B events (~0.25PB) over a sliding activity window using multiple aggregation phases.

Santa Clara, Ca, Us

Responsible for planning and development of algorithms supporting machine learning, product pricing, and complex data visualization. Interact closely with data engineering to communicate the analytic organization's structured and unstructured data requirements. Explore, assess, and apply new technologies in big data and distributed computing to a wide variety of new and old problems.

Santa Clara, Ca, Us

Enterprise data warehouse architecture, design, and development. Specific duties in data modeling and ETL platform architecture/development. Developed an ETL framework system to handle data dependencies, error handling, and process management fostering rapid ETL development in horizontally-scaling infrastructures. Explored and implemented a wide array of cloud-capable technologies including Teradata Aster and Hadoop.

San Jose, Ca, Us

Systems administration, configuration, and automation for database, ETL, data warehouse, and Hadoop clusters. Implemented configuration management software (Puppet) to manage multiple 1000+ node Hadoop clusters.

Merced, California, Us

Notable Accomplishments & Projects:- Data Warehouse Implementation- Business Intelligence Software Implementation (IBM Cognos)- Operational Data Store Software Implementation (Sungard ODS)Roles & Responsibilities::: Data Warehouse Architecture ::Worked closely with the Office of Institutional Planning & Analysis to architect a data warehouse strategy. Currently working on business data modeling, dimensional data modeling, and implementing new ETL software (Oracle Data Integrator).:: Software Engineering ::Designed and developed custom software to extract, transform, and load data in to the data warehouse using PL/SQL with a Cold Fusion-based graphical user interface.:: Business Intelligence Administration ::Worked with the Office of Institutional Planning & Analysis to select, implement, and administer a campus-wide business intelligence solution (IBM Cognos). Currently working on developing Cognos Framework Manager metadata models to access dimensionally modeled relational star schemas.:: Operational Data Store Administration ::Managed the implementation of Sungard's ODS product for student information. Worked with multiple business units to enhance and develop the vendor-provided product to suit specific business needs. Designed, developed, and maintained custom ETL mappings using OWB to integrate data from identity management, finance, human resource, and payroll systems.

Merced, California, Us

Notable Accomplishments & Projects:- Development of the Admissions Application Evaluation Process- Student Recruitment System Implementation- Consolidated Communication Processes ImplementationRoles & Responsibilities::: Information Systems Management ::Developed business processes to evaluate admissions applications. Implemented technical solutions to improve application evaluation processes. Administered websites and web-based applications.:: Software Engineering ::Designed, developed, and implemented integrated web-based systems using Oracle, SQL Server and Cold Fusion (Student Recruitment Information System, Reporting & Business Intelligence System).:: Report Development ::Developed operational and analytical reports. Integrated data from internal and external sources.:: Data Quality Supervision ::Supervised data collection duties assigned to student recruiters by the director of undergraduate admissions. Managed small teams of data entry personnel.

Dallas, Tx, Us

Notable Accomplishments & Projects:- Consolidated Help Desk Operations- Online Help Desk Implementation- Call Center Identity Management Implementation- Content Management Software ImplementationRoles & Responsibilities::: SQL Server Database Administration ::Responsible for security, maintenance, and upgrades of 4 SQL Servers running 62 databases.:: Web Server Administration ::Responsible for security, maintenance, and upgrades of 14 Windows-based Cold Fusion servers over 4 domains utilizing hardware-based load balancing & fail-over.:: Project Management ::Managed telephony projects for the western region. Negotiated contracts to replace traditional (Centrex) telephony systems with internally managed equipment (PBX/VoIP).:: Business Process Management & Problem Management ::Measured, analyzed, and reported on IT performance using data from trouble ticketing systems, employee comments, and customer satisfaction surveys. Advised IT management of options to achieve service level targets, improve efficiency, and reduce costs. Developed software tools to improve IT operations.