Just starting out as an angel investor. I'm focusing on sustainability and technology supporting developers.

- Automated safe cloud hardware updates for large scale PostgreSQL cluster- Contributed to high performance PostgreSQL proxy for transparent sharding- Automated service management for safely stopping problematic cloud service task instances

- Built multi-environment setup for company-wide testing and validation- Built monitoring tools for services and end-to-end testing tools

- Setup a data pipeline for rapid processing of ad data at Instacart- Built testing frameworks for the processing pipeline to confirm correctness of business critical measurements

Search Infrastructure Team:- Increased reliability of Elasticsearch at Instacart from "goes down most weekends" to better than 99.9% success rate- Built tools to capture and analyze data for Elasticsearch queries to help identify problematic queries and usage patterns- Built robust set of tests to gain confidence in deployments of Elasticsearch related code- Introduce the first production golang service to Instacart

Senior Software Engineer 2 on the Data Platform team at Twilio focusing on ElasticSearch.- DevOps work to integrate ElasticSearch with Twilio's internal deployment tools- Resilience testing of ElasticSearch in an AWS environment- Develop ElasticSearch best practices for internal users- Develop Kafka to ElasticSearch indexer

- Develop server and service problem detection and remediation tools used to manage hundreds of thousands of systems- Develop tools for testing failures of various infrastructure components- Break things on purpose to make everything more resilient- Run failure tests of various infrastructure components- Run site-wide stress and load tests- Analyze traffic patterns for high traffic events and develop load tests to verify site functionality under high load conditionsTools and technologies used:Scala, Python, Heron, Storm, Summingbird, Bash, Linux, Git, IntelliJ, Pants, Aurora, Mesos, PagerDuty, and a lot of internal Twitter toolsRead a little about this position at https://blog.twitter.com/2014/push-our-limits-reliability-testing-at-twitter

- Day-to-day operations for some of the largest Hadoop clusters in the world (9k+ nodes, see http://www.slideshare.net/Hadoop_Summit/hadoop-hardware-twitter-size-does-matter and https://twitter.com/joep/status/707733536187359232 )- Automate cluster management tasks with Puppet, Python, Scala, Bash, and other code- Integrate Hadoop with the internal Twitter infrastructure like https://blog.twitter.com/2013/observability-at-twitter- Support hundreds of users in multiple multi-tenant Hadoop clusters, see https://blog.twitter.com/tags/hadoop?blog=engineering for an idea of the complexity- Investigate some very odd edge-cases like https://twitter.com/joep/status/642415840839622656- Customer support for diagnosing issues with jobs running on Hadoop clusters- Capacity planning for large clusters with 100s of users- Internal consulting for other Twitter teams for issues related to Hadoop, HDFS, and YARN- Networking expertise for Hadoop including working with Network engineers, DSCP, TOS, Cacti, NFSen, tcdump, iperf, bandwidth policers, packet drops, network congestion, and internal lots of internal Twitter monitoring- Provide operational expertise to the Hadoop development team like https://issues.apache.org/jira/browse/HDFS-7541 and https://hadoopsummit.uservoice.com/forums/344967-future-of-apache-hadoop/suggestions/11664786-upgrading-a-10k-node-hadoop-cluster-with-zero-down- Support monitoring and alerting for Hadoop clusters- Participate in the on-call rotation for HadoopTools and technologies used:Scala, Python, Hadoop, HBase, HDFS, Yarn, Java, Ansible, Ruby, Puppet, Bash, Linux, Git, IntelliJ, Pants, Aurora, Mesos, Presto, PagerDuty, and a lot of internal Twitter tools

- Automated day-to-day cluster monitoring and maintenance tasks- Tripled existing Hadoop cluster processing capacity through Hadoop configuration and Linux optimization- Add metrics for performance tracking- Provide internal training on Hive, Impala, and Hadoop- Create a Vagrant based Hadoop development environment- Develop Ruby applications for interacting with Hadoop and HiveTools used:Hadoop, Hive, Impala, CDH4, CDH5, Sqoop, Luigi, Python, MySql, Ruby, Vagrant, Graphite, Ganglia

Main developer of the big data analytics portion of Crowd Control- Continually improve performance of batch data processing jobs based on Hadoop Map Reduce- Research and implement new tools and techniques- Work with UI and business teams to determine data needs- Work on a petabyte scale Hadoop cluster- Provide tools for ad-hoc data analysis using Pig and HiveTools used:Hadoop, Hive, Pig, Map Reduce, Java, Ganglia

Senior developer on multiple projects- Prototype development of large scale data processing with Hadoop and Pig- Development of RESTful web services

- Implement high throughput complex event processing system- Develop XML based web services

- Setup development environment and processes

- High performance Java development for geospatial visualization- Engineering Sales Support- Rapid prototyping- Customer support

- Java development- Setup development processes

- Embedded development- Software testing- QA