Emmanuel Jamoralin Email & Phone Number

Taguig, National Capital Region, Philippines

Metro Manila, National Capital Region, Philippines

Apply data engineering principles to develop reusable workflows including ingestion, quality, transformation and optimization. Utilize the principles of cloud architecture to migrate data from outdated data warehouses.Milestones-Successfully conceptualized and implemented 5 pipeline solutions, presenting and securing approval from my team lead.-Designed and created more than 40 AWS Glue script-Function as the Subject Matter Expert (SME) within the team, serving as the primary point of contact for inquiries related to AWS technologyMy responsibilities are:- Develop a comprehensive system designed to proficiently collect, validate, and prepare high-quality data, leveraging the capabilities of AWS Glue, AWS Redshift, and AWS S3.- Supervise the daily execution of clients' AWS Glue jobs, promptly intervening to address any issues that may arise.- Ensure the Jira ticket is regularly updated to communicate our current progress and status in the development process.- Provide documentation at the right level, to help others understand and support what we have built.- Helped the team to developed and executed a migration strategy to move Data Warehouse from Azure platform to AWS Redshift.-Provide guidance to my colleagues when they require assistance or encounter blockersContributions:- Architect and implement an automated system for weekly backups from 2 AWS Redshift clusters, with the subsequent storage of these backups in a lower environment database.- Enhance the AWS Glue script to achieve an approximate 200% increase in the efficiency of the cube run. The optimization results in a significant reduction in processing time, from 8 hours to approximately 2 and a half hours.- Architected and implemented a notification system designed to send email blasts upon the execution of AWS Glue jobs. This was achieved through integration of AWS Glue, AWS SNS, AWS EventBridge, and AWS LambdaSkills:AWS Glue, AWS Redshift, AWS S3, PostgreSQL, SQL, Python, Pysparks