Implemented APIs to scrape public data, supplementing in-game data and crash reports for improved analysis and troubleshooting. Created a testing pipeline for an internal KPI reporting system, streamlining issue tracking and enhancing workflow efficiency. Led the development and maintenance of ETLs, integrating third-party data to ensure a robust and scalable data architecture. Collaborated with multi-functional teams to improve code quality and infrastructure, driving innovations across large-scale data systems. Monitored and optimized machine learning-based alert systems for anomaly detection and trend identification, ensuring data and game reliability.

Designed updated systems to reorganize and maintain key data pipelines running with minimum upkeep, resulting in a substantial reduction in maintenance efforts and resource allocation. Engineered automated tools for expedited pipeline deployment, version control, and data quality assurance, streamlining overall operations. Championed data quality assessments, leading to the discovery and resolution of recurring data anomalies that had been previously obfuscating actual issues. Played a pivotal role in recurrent ETL work (SQL/Python) and data dashboarding to elevate the visibility of crucial data in discussions surrounding Portal device initiatives.

Built a record linkage engine that is maintained in Scala to process very large data (500GB+ compressed) and join to an even larger data warehouse (10TB+ compressed). The data is stored in columnar format – Parquet – to enable data skipping and efficient bloom filtering. Worked with Elasticsearch to load data to be consumed by API and easily searchable Migrated an on-premises Hadoop and HQL implementation to Amazon Web Services (AWS) and updated an HBase-centric implementation to a Data Lake oriented implementation using Elastic Map Reduce (EMR) and S3. Logging and monitoring are implemented using SumoLogic Created data pipelines in Airflow and CI/CD using TeamCity and S3

Worked with a team of developers to maintain our Oracle database and associated .NET services which delivered data to Process Engineers Maintained a local website (Frontend: React, API: C#, Database: Oracle) which presented data to make informed decisions Worked with team to implement sprint-based system including code review

Created a video based report card that takes students marks from an excel database using Excel macros and MS Access. Translated into an html video via JavaScript to create a playable mp4.

Work with social media API’s such as Twitter, Instagram, and Vine. Search API’s to find trending stories for use in media. Use results to add additional information from other API’s such as adding Instagram pictures to a story created from twitter hashtags.