Nishant Jain Email & Phone Number

Bengaluru, Ka, In

Bengaluru, Karnataka, India

Data PurgeImplemented Python Automation and Visualization for BigQuery Data Purging.Developed a Python automation script for Google BigQuery, enabling users to define parameters for efficient table/partition purging, streamlining data management processes, and reducing manual intervention by 70%.Established Auto Expiration policies within BigQuery to automatically delete tables and partitions after a predefined period, such as 30 days, effectively managing storage costs and ensuring data hygiene.Developed a Tableau dashboard for multiple domain teams to visualize purging activities, displaying metrics such as the current amount of storage reclaimed and the total cost saved to date.Purged 510 TB of Data, resulting in an estimated annual cost savings of approximately $125337 based on prevailing BigQuery storage rates.Debugged and refined multiple Python ETL scripts that created false SLA incidents, resulting in 100% accuracy. Optimized complex SQL queries exceeding 500 lines using Generative AI tools, enhancing data extraction and transformation processes.

Bengaluru, Karnataka, India

Wrote a script that generates an alert mail to the concerned team when the disk capacity on remote machines exceeds 90%. Gives an entire description of filesystem disk space usage on that machine.This script is further automated to be executed every hour using Airflow.Technology Used: Python.