Data Engineer
CurrentKey Responsibilities:• Lead weekly client meetings to identify clients’ needs and ensure ongoing success• Gather requirements from clients to effectively build 16+ data pipelines to ETL ~5 TB of data daily to Snowflake warehouse using Python, Lambda, Step Functions, EMR, Spark, Docker containers, ECR, ECS • Define data strategy and provide data modeling solutions for external and analytics data enabling fast and intuitive access for data teams and business users• Participate in building Tableau dashboards to aggregate data from across games portfolio into executive reportsKey Achievements:• Annotated App Store/Google Play reviews, user feedback, and media comments using Sage Maker and Lambda, generating insights into customer experience• Processed and unified across millions of server logs daily with PySpark to improve in-game metrics• Built real-time data streaming system for Sony Game Entertainment using AWS Kinesis, Lambda, Snowpipe to record user events on their apps, driving real-time insights and contributing to 10 million revenue each year• Developed real-time monitoring systems to provide immediate awareness of database performance, data pipeline failures and data integrity, freeing up manual checking efforts and increasing operating efficiency by 20%