Cloud Data Engineer
CurrentDesigned and developed Apache Beam/Dataflow pipeline using Java, handling the processing of over 800 TB of data monthly, increasing data throughput and reliability.Optimized data processing operations and improved pipeline scalability, ensuring stable data flow and performance under high-volume conditions.Developed a BigQuery policy enforcement Cloud Run Python application that automatically enforces and synchronizes policy tags across BigQuery datasets and tables using the BigQuery API, Data Catalog API, EventArc, and Firestore, ensuring data governance and security compliance during data reloads and table modifications.