Design and develop API modules using Python's FastAPI framework to facilitate data retrieval from various sources (Azure Blob, Amazon S3, GCS Bucket, SFTP, or local) based on user selections. I also implement cloud-based scheduling with Cloud Scheduler to automate data acquisition tasks, ensuring data is fetched at designated times, which enhances efficiency.Furthermore, I integrate data pipelines by orchestrating Cloud SQL data storage with Pub/Sub messaging. This allows for efficient data transfer and triggers Dataflow jobs for further processing.I leverage Cloud SQL for data persistence and Cloud Scheduler for automated execution, streamlining data pipelines.

Working as Data Engineer- Developer , migrating Onpremise system with Peta Bytes of Data into Google Cloud.Understading the Logic in Onpremise jobs (Workflows, Reuseable session ,generic Scripts ) and closely working with IPS ( informatica professional services ) to identify the limitations of Informatica Cloud Compared to onpremise(Informatica Power Center ) systems.Having good hands on experience in Google Bigquery, Shell Scripting , git , bitibucket , bambo, Control-M.Working as team player ,resolving defects raised by QA team, Client,Business teams in various environments like Preproduction, UAT and Production with in SLA.Having hands on Experirence on tool Bitbucket for easy version Control and Code management.Used Tool bamboo For Code deployment in Various Environments (QA,UAT,Production)Using tool Jira for Defect / Bug tracking and resolving in given SLA.