Senior Data Engineer
Current• Migrated all legacy AWS Glue ETL/ELT jobs into Redshift to run in Apache Airflow, substantially increasing visibility and reliability of those jobs.• Architected and developed system to extract customer Salesforce data via Salesforce Bulk API and leverage that data to enhance the metadata for customer conversations on our platform, resulting in valuable insights for customer sales opportunity pipelines.• Designed and implemented data pipeline to create summaries, follow emails, coaching feedback, and coaching scorecards for customer conversations using Generative AI.• Mentored junior engineers in design and best practices, as well as reviewing their work both interactively and via pull request.• Performed performance tuning on Redshift cluster and tables, resulting in significant performance improvements for customer facing reports.• Technologies: Python, Airflow, Redshift, S3, SQS, SNS, AWS RDS: PostgreSQL and MySQL, Bash, AWS Glue, Salesforce, Metabase, Git, GitHub, Jira