Senior Data Engineer
Current- Spearhead the initiative to enhance data observability by implementing Monte Carlo for data alerting and monitoring for 100% of Wirecutter data assets, ensuring data quality and reliability. This helps our organization detects and triage data issues such as staleness or unexpected drops in traffic/revenue- Lead the initiative to introduce dbt Core at Wirecutter on terabytes of traffic data. Personally designed and implemented dbt Core with the stack of Kubernetes on Airflow (Cloud Composer), Drone for CICD and BigQuery- Fine-tune BigQuery performance. Many long running querries were optimized to run from 1 hour to only 5 minutes.