Software Engineer
- Data Engineering: Developed, tested, and maintained data pipelines, including ETL for over 60 ad networks to be used in over 300K reports per day- DataLab: Designed and implemented self-service tool for internal users to create and manage their own data pipelines, freeing up development cycles for the rest of the Data Engineering organization- Airflow Migration: Migrated workflow software (Apache Airflow) from provisioned hosts to managed Airflow on Kubernetes, reducing time spent… Show more - Data Engineering: Developed, tested, and maintained data pipelines, including ETL for over 60 ad networks to be used in over 300K reports per day- DataLab: Designed and implemented self-service tool for internal users to create and manage their own data pipelines, freeing up development cycles for the rest of the Data Engineering organization- Airflow Migration: Migrated workflow software (Apache Airflow) from provisioned hosts to managed Airflow on Kubernetes, reducing time spent maintaining and debugging workflows- Reporting API: Developed and maintained System1’s REST-based Reporting API- Snowflake Data Warehousing: Developed, managed, and maintained a Snowflake data warehouse processing over 100M events per day Show less