Software Engineer
Conducted migration, optimization, and feature development of data validation and management processes across large-scale data infrastructure. Focused on improving efficiency, security, and cost-effectiveness of company's data lake, ETL pipelines, and APIs, while providing training and documentation for operational teams.• Migrated data validation code to a source-controlled, automated Google Cloud Functions system, reducing processing time by 15% and improving maintainability through unit testing and documentation.• Converted company's largest data lake to ZSTD compression, saving $700K+ annually by optimizing storage costs.• Enhanced security by migrating the Trino/Presto cluster to Auth0 JWT authentication, supporting zero-trust security model.