Gaurav Sharma Email & Phone Number

Bengaluru, KA, IN

Bengaluru, Karnataka, India

• Working on building Datawarehouse solution for banking data analysis.
• Developed and automated the data ingestion process which fetches the data from SFTP server using cloud functions that stores the data in GCS Buckets.
• Developed scalable pipelines using Apache Beam and DataFlow(GCP Managed service) to validate, cleanse, augment and ingest the data into BigQuery.
• Developed robust mechanism to handle the failure condition which handles the rejected records while… Show more Working on building Datawarehouse solution for banking data analysis.
• Developed robust mechanism to handle the failure condition which handles the rejected records while validating along with ingestion to datawarehouse.
• Developed the data masking solution to mask or pseudonymise the attributes using unified pipeline.

Bangalore Urban, Karnataka, India

• Worked as Uber-Ext Data Engineer I developed robust, scalable pipeline to continuously feed the data to the downstream tables.
• Developed and automated process to pull the data from different external sources e.g: GDrive, Box and integrate the system to manage clean and load the data into Hive Tables.
• Developed a Framework which automatically the picks the data from source and build pre checks for data quality apply transformation to raw data and feed into Hive… Show more Worked as Uber-Ext Data Engineer I developed.
• Developed a Framework which automatically the picks the data from source and build pre checks for data quality apply transformation to raw data and feed into Hive Tables and builds post-ingestion checks which checks.
• Developed a framework which regularly checks the tables status if there is any kind of data irregularity and incorrect data ingestion.
• Fixed the data quality of the existing tables for better insights. Show less

Gurgaon, Haryana, India