Sagar Jaiswal Email & Phone Number

Pune, Maharashtra, India

Pune, Maharashtra, India

● Create a databricks solution for anomaly detection on daily ingest for multiple tenants● Worked on analysis and optimization of dataflow process by ~50% in runtime and dollar cost onan organization level● Integrated data lineage into DBT by automating exposure creation through Tableau API andcreating CI/CD for updating lineage on pull requests

Pune, Maharashtra, India

● Worked on various migration projects by developing ETL processes in Matillion● Optimized ETL process to reduce runtimes by ~60 %● Created workflows to automate stat gathering post-data ingestion● Developed, automated, and optimized historical data ingestion to run 24x7 and reduce manual efforts● Created reports post-ingestion to provide insights on data and perform validations● Created various DB designs● Created Architecture and implemented ETL processes to migrate data from various ETL sources (API, Flat files in SFTP, Postgres, etc) to a homogenous form in Snowflake● Implemented CI/CD flow to deploy to different environments● Experienced working with various file formats like Parquet, Avro, CSV, JSON, etc.● Developed recommendation engine ETL process

Pune, Maharashtra, India

● Developed complex ETL process from scratch using Matillion leveraging GCP● Migrated data pipelines from GCP Cloud Data Fusion to Matillion● Created an automation pipeline to generate post-ingestion reports, significantly reducing manual work from 3 days to approximately 30 minutes leveraging ETL Matillion & BigQuery● Built data platform code from scratch and Migrated existing ETL workflows from Fivetran/API/SFTP to Snowflake using Docker and Airflow and GCP services, handling diverse data types from various APIs and flat file sources● Created custom wrapper Python packages hosted on GCP Artifact Registry to be used across different data connectors● Created a Python-based email classification pipeline to streamline data handling and prioritise emails for faster response

Pune

● As a member of an Agile team focused on continuous delivery, my role involves developing, testing, and deploying ETL (Extract, Transform, Load) batch processes using Ab Initio. These processes contribute to the creation of real-time business models.● Worked on batch process optimizations reducing runtimes by ~70%● Migrated data from various sources to the Snowflake data warehouse● To improve productivity, I developed various automation scripts using shell scripting and Python. These scripts significantly reduced the time required for repetitive manual tasks during the development and validation processes.

Pune, Maharashtra, India

● Worked on developing ETL pipelines in Ab initio