Senior Data Engineer
Current- Led migration from AWS DocumentDB to MongoDB Atlas, improving system performance and reducing operational costs- Designed and developed scalable data pipeline using AWS Glue and PySpark for data processing and transformation- Created reusable PySpark functions to automate workflows, improving efficiency- Developed Athena views and AWS Lambda scripts to.