Data Engineer
Initially reporting directly to our CTO, I built Python-based data pipelines using a combination of AWS Lambdas, Athena (Presto & Trino), Postgres, Redshift, Pandas, and Jenkins CI/CD, eventually moving to a larger engineering team, working with AWS Managed Workflows for Apache Airflow (MWAA), Apache Iceberg, and Docker in order to lower operating costs via AWS Fargate. I also developed a variety of DevOps tooling during this time, heavily utilizing the GSheets API, Playwright browser scraping, and Python to quickly publish, and automatically update, bespoke team-oriented dashboards and data entry tools which might have otherwise required large development efforts to accomplish. After having the opportunity to expand my knowledge of AWS infrastructure, I am now much more confident about choosing the right AWS tools and services, depending on project scope, scale, and goals.