Senior Software Engineer
Current• Maintained and migrated existing ETL jobs to ensure near real-time and daily transfer of 10 million rows of data between Salesforce, Snowflake, and Amazon S3, using Python, AWS Step Functions, Lambda, Glue, and EventBridge.• Designed and implemented a new microservice ETL system, increasing capability by 10x to onboard and process multiple data sources, using SOQL, SQL, Pandas DataFrame, and REST API.• Provided production support to resolve data anomalies for 100+ Business Analysts, using Python, Pandas, PySpark DataFrame, CloudWatch, SOQL, SQL, and Splunk.• Implemented automated acceptance and functional tests for new features, using Python Behave, Jenkins Pipeline, and Jira X-ray, enabling continuous integration.• Improved unit test coverage to over 95%, ensuring product compliance with enterprise standards and providing flexibility in test coverage requirements for new features, using Python.• Developed Infrastructure as Code (IaC) to manage instances and resources for the microservice system, using AWS CDK and CloudFormation.• Enhanced error handling and logging to reduce debugging and trace-back time, using Python and AWS CloudWatch.• Automated AWS deployment in the development environment, achieving a 10x improvement in deployment speed, using Linux shell scripts.• Documented step-by-step procedures in Confluence to streamline knowledge transfer and reduce onboarding costs.