Building observability for Postgres and Oracle Connector microservices by implementing health checks, metrics collection, storage, visualization and monitoring to facilitate near real-time monitoring, visibility, alerting and provide performance insights

Joined the ELT data pipelines team and contributed towards: 1. Optimized SQL data connectors for Oracle, PostgreSQL, and SQL Server by fine-tuning SQL queries and parallelizing data ingestion, resulting in a reduction for initial historical sync time and a decrease in source database impact.2. Enhanced the Oracle connector for CDC by implementing multithreaded parallelism in log reading and processing, improving throughput and reducing latency, supporting near real-time data capture. Introduced features that lowered database resource utilization during extraction,. Additionally, developed a dynamic schema evolution feature that seamlessly handled table schema changes, ensuring uninterrupted data flow. 3. Participated in on-call rotations with stringent 24 hr TAT SLAs, handling incident response, system monitoring and problem diagnosis to resolve high-priority customer issues. Coordinated with internal teams and stakeholders, managed communication, documentation and implemented process improvements to ensure system reliability and compliance. 4. Played a key role in development of a template-based SaaS connector framework which enabled creation of new Analytics and CRM connectors like HubSpot, Salesforce, and Klaviyo using JSON configuration files to define connector behavior, resulting in a reduction of average SaaS connector development time from 3 weeks to 1 week.

Worked on Hevo Activate- a reverse-ETL Saas product that enables customers to synchronize valuable customer data residing in their data warehouse with target CRM application, enabling them to run better marketing campaigns. 1. Developed Mailchimp and Clevertap integrations as targets in Activate which helps customers run better email campaigns with up-to-date customer data from their warehouse. 2. Worked on customer critical on-call issues and queries related to Activate.

Worked in a team of three to architect a three-tier web application architecture as a template on AWScloudformation which allowed for a quick setup of a highly available, scalable, secure and fault tolerant three tier web application architecture.