Gcp Developer And Test Analyst
CurrentThis project involved receiving raw data from mainframe systems as text files over NASservers and loading it into Google Cloud Storage using shell scripts triggered by Control-M. The raw data was validated and cleansed using custom dataflow jobs and then loaded into BigQuery tables. SQL scripts were utilized to transform the data across different datasets, and the transformed data was exported to GCS for downstream analysis. The code repositories were maintained using BitBucket. This project resulted in improved data accuracy and quality, faster data processing times, and more actionable insights for stakeholders.