Data Engineer
CurrentLed communications with department leaders and engineering teams at WhoisXML for the database migration to AWS project, delving into business requirements and technical challenges to determine migration strategies.Designed and executed an automated data processing pipeline for transferring and transforming data from the original database to AWS S3 buckets, ensuring data security and integrity. Collaborated closely with the QA team to maintain high standards and accuracy during the data migration process.Leveraged AWS Lambda, API Gateway, and Cognito to develop secure data access points and robust user authentication systems, enhancing data access flexibility and system security through pre-signed URLs and token-based API access.Developed a real-time dashboard to monitor the progress and performance of data migration, providing key project insights to the management team.