Developed multiple Data Pipelines - I have a track record of creating data pipelines that provide valuable insights to support business decisions.FDRE Project - The goal of the project was to create multiple deduction files of clients from a single framework, streamlining the reconciliation process and improving data accuracy. I used technologies such as Pentaho Tool to extract data from various sources, including client databases and file system. Then, I cleaned and transformed the data to ensure its accuracy and consistency and file format requirement (FL,DL,XML,CSV) before shipping out the files to our clients.I am responsible for setting up, configuring and monitoring the EMR cluster, which is used to process and analyze large amounts of data.In addition, I manage and maintain the Greenplum data warehouse system. This includes configuring and optimizing the system for performance and scalability, as well as monitoring the system for any issues or errors.

Gain hands-on experience in building data pipelines. I was able to learn about the different stages of data pipeline creation, from data extraction and cleaning to data storage and analysisProposed POC for File Deduction Regenerate Engine using tools/ languages such as Pentaho , Javascript and SQL.