Director Of Engineering, Data Engineering
CurrentLeading the Data Engineering department, providing analytical data storage, data pipeline services, and business intelligence solutions for Nielsen Global Engineering.Managing 5 SCRUM teams, implementing data engineering solutions for Nielsen's core global data collection and processing platforms (TV Ratings US, TV Ratings International, Audio/Radio Ratings, Streaming/Digital Ratings, Program Asset Monitoring - Streaming Program vs Commercial Classification). Leading Cloud Data Lake / Data Warehouse / Data Lakehouse strategies for data in the petabyte range, 700+ tables, consuming and processing multiple terabytes of Nielsen data collected daily from around the globe, including snapshot and streaming data. Implementing solutions for ETL/ELT/data pipelines for business consumption, analytical data storage, machine learning, artificial intelligence, and business intelligence. 100+ data pipelines, batch and streaming, event driven architecture.Managing data governance, including data catalog implementation, coordinating data stewardship, ensuring data quality, managing data lifecycle, securing Pii data, enforcing data protection and compliance with US and GDPR data protection laws.Providing Business Intelligence solutions (SpotFire, Microstrategy, Superset).Managing AWS FinOps cloud cost forecasting and optimization (>$1M annually), software license optimization, and open source software adoption.Managing the creation of various custom Nielsen data services and APIs to support the generation of the Nielsen Ratings, and to provide data insights to external clients and external compliance auditors. Creating and Leading outstanding Agile technology teams in a CICD environment using tools such as: Amazon Web Services AWS (S3, EC2, EMR, MSK Kafka, PostgreSQL RDS, Aurora RDS, SQS), Iceberg, Nessie, Trino, Hive, Spark, Python, Java, Go, ReactJS, PHP, Docker, Grafana/Prometheus, Jira, GitLab, Slack, Sonarqube, Checkmarx, GitlabSAST