Software Engineer
Current- Spearhead the design and implementation of deterministic encryption/decryption for client-sensitive data, carefully balancing methodologies to integrate this feature seamlessly into existing workflows, and preparing transition guides for legacy data.- Develop and manage 200+ data pipeline jobs and sensors in Dagster, aligning with complex data dependencies to drive client success; contribute extensively to development logs and documentation to streamline team processes.- Design and build the ML pipeline for a PoC project, enabling frequent, automated experiments tailored to complex customer scenarios, utilizing tools like dbt, Dagster, and Bazel.- Enhance team productivity by optimizing CI processes across the organization, minimizing unexpected Python lint changes, and significantly increasing linter speed in VS Code; concurrently, refactor and remove 10+ unused configuration-related code in the monorepo to uphold code quality and maintainability.- Lead a Design Patterns workshop for engineers to foster a culture of continuous learning, improve engineering capabilities, and build a strong technical community within the company.