Streaming Platform

Domino allows data scientists to collaborate, develop, and deploy their work. The application is written in Scala, with support code in Python and Go. The product installs into a Kubernetes cluster on multiple clouds and on premise.As an early engineer I led the formation of multiple teams, onboarded new cohorts of engineers at all levels.Next Gen Architecture: Worked with a small team to design an event-based micro services architecture to improve scalability and team independence. Developed strategy for incrementally strangling the monolith to provide value at each step. Created a reference implementation to aid development teams in best practices and design approach, including implementations of multiple cross cutting services.Volume Manager: Wrote a Kubernetes volume manager that maintains a cache of pre-staged volumes for faster startup times with configurable retention policy.Log Jam: Rearchitected system that allows users to view their workload logs in realtime using Fluentd, Redis, and S3, replacing a solution that caused daily escalations.Message-Based Executor: Redesigned the executor to use messaging rather than polling, which was the top source of web requests in the system. This reduced CPU utilization by two orders of magnitude.Model Manager: Created model hosting product using Kubernetes. Created a saga framework to orchestrate workflows.Restartable Workspaces: Added ability to pause and resume Workspaces resulting in faster startup time.Training Sets: Added feature that allows users to store Pandas Dataframes and associated metadata with a Python client. Improved pattern for creating endpoints using OpenAPI 3, now being adopted across the product.Datasets: Added ability to work with large filesets using shared mountpoints.Git Integration: Added Git UI and workflows to Workspaces.Load Testing: Created deployment seeding and load testing tools.Play Upgrade: Upgraded Play from 2.4 to 2.6. Unblocked use of several libraries and frameworks.

* Member of the Analytics team.* Transitioned from JSON to Avro for HDFS ingestion.* Performed Hadoop upgrades.* Designed data warehouse built from data from 21 games with varying event schemas.* Wrote event logging libraries in Java, Objective-C, and Python. Contributed to the Ruby and PHP libraries..* Debugged Elasticsearch and Hadoop operational issues.* Automated deployments in Jenkins.* Migrated job scheduling from cron to Airflow for better visibility and control.* Set up a PyPi repo to facilitate Python code sharing.* Wrote a Gradle plugin to provide build and deployment tasks.

* Tech lead for the Payments team.* Brought together existing payments code into a unified framework.* Drove a continuous effort to pay down technical debt.* Expanded our subscription offering to support multiple payment providers.* Worked with ops to design a PCI compliant credit card processing service.* Added new payment providers including PayPal, SponsorPay, RadiumOne, Amazon, and Boku.* Added integration with Kount rules engine, allowing self-service rule sets by our analysts.* Implemented various security measures to reduce fraud including 2FA.* Set up a stats collection system with statsd, graphite, and flot.* Generalized our Gold purchase flow to support purchasing arbitrary products.* Set up Java backend to segregate code requiring access to third party credentials to servers with restricted access.* Created restoration scripts to reconstruct lost data after a catastrophic database failure.

* Contributed to Sorority Life and bootstrapped Blackwood and Bell Mysteries.* Prototyped new games for product managemment team.* Onboarded new engineers, growing the team to a dozen in a few months.* Set up development, QA, and Production environments with ops team.* Load tested production environments up to 1 million DAU for game launch.* Reworked CMS to be self-service, eliminiating a time consuming engineering task.* Migrated data to the company's cloud service.

* First hire helped establish the codebase.* Designed application server for product.* Designed system for loading and upgrading new plugins into the system on the fly.* Designed and implemented the management API.* Created database schema update framework with Ruby.* Designed the build system to allow conventions based multi-module builds.* Designed framework for processing network traffic.* Implemented protocol handlers for HTTP, FTP, and SMTP.* Wrote Web Filter, Virus Blocker, and Spyware Blocker.* Designed a reports system system using Python and JFreeChart.* Wrote a Remote Access Portal with file browser, web proxy, and remote desktop support.* Wrote a service for distributing spyware and malware list updates.