Senior Software Development Engineer
Current- Started as a member of the AWS EMR sub-team that owns all open source BigData applications that run on EMR, adds support for new applications, and ensures that we keep as up to date as possible with new versions.
- Was a founding member of a new sub-team focused on continually improving the performance of the AWS distribution of Apache Spark. Worked extensively in an AWS fork of Apache Spark, implementing, reviewing, and.
- Designed and implemented processes for keeping the AWS fork of Apache Spark as up to date as possible with the upstream branches so that we may release new versions of AWS Spark ASAP after an open source release.
- Designed and implemented a telemetry pipeline for analyzing usage patterns of EMR Spark customers.
- Contributed to an internal tool used by multiple teams to run industry standard benchmarks like TPC-DS.
- Work closely with AWS Premium Support as a SME Board examiner, certifying new EMR SME members.