Data Engineer
Current◆ Pipeline Overhaul: Reduced costs by 50% using Apache Beam Dataflow (Java SDK) by revamping the event-driven pipeline architecture, implementing robust logging, and ensuring system accuracy.◆ Database Migration: Migrated 500M user records from Firebase to Firestore, optimizing the data pipeline and reducing costs by 20%.◆ BigQuery Optimization: Redesigned BigQuery schema and structure, implementing materialized views for OLAP operations, reducing query and active storage costs by 30%.◆ Logs Pipeline Implementation: Developed and deployed a comprehensive logs pipeline using Apache Beam Dataflow and message brokers, enhancing data flow and monitoring.◆ Custom Branding Solutions: Engineered instant duplication of CustomerLabs into agency apps using Caddy server, providing custom domain branding and updating tracking domains.