Senior Software Engineer
Current- Updated daily legacy batch extraction process to read AWS DMS data for all booked U.S. Card accounts from S3 in Databricks with Pyspark and write the delta files to a data lake. The Pyspark application allows for a.
- Maintained and supported real-time business critical Python APIs using a decoupled AWS architecture with ECS, SQS, and Lambda to provide Know Your Customer verification data on incoming individuals and small businesses.
- Designed, developed, and maintained Python APIs using a serverless architecture model with AWS Lambda to support updates and retrievals of booked U.S. Card accounts.
- Maintained and supported Python process to ensure the Cassandra cluster that fulfils Rewards redemptions has the most recent AWS AMI. Using the most up to date AMI satisfies security best practices and the Python.
- Served as implementer and point person for a biannual disaster recovery activity that required our microservices to successfully switch live production traffic from the active AWS region to the passive region with a.
- Wrote applications using an internal tool that wrapped over AWS EMR to perform high volume writes and updates to our business critical database. The application was optimized such that the CPU load and write IOPS on.