Software Development Engineer - 1
Bengaluru, Karnataka, India
Joined the ELT data pipelines team and contributed towards: 1. Optimized SQL data connectors for Oracle, PostgreSQL, and SQL Server by fine-tuning SQL queries and parallelizing data ingestion, resulting in a reduction for initial historical sync time and a decrease in source database impact.2. Enhanced the Oracle connector for CDC by implementing multithreaded parallelism in log reading and processing, improving throughput and reducing latency, supporting near real-time data capture. Introduced features that lowered database resource utilization during extraction,. Additionally, developed a dynamic schema evolution feature that seamlessly handled table schema changes, ensuring uninterrupted data flow. 3. Participated in on-call rotations with stringent 24 hr TAT SLAs, handling incident response, system monitoring and problem diagnosis to resolve high-priority customer issues. Coordinated with internal teams and stakeholders, managed communication, documentation and implemented process improvements to ensure system reliability and compliance. 4. Played a key role in development of a template-based SaaS connector framework which enabled creation of new Analytics and CRM connectors like HubSpot, Salesforce, and Klaviyo using JSON configuration files to define connector behavior, resulting in a reduction of average SaaS connector development time from 3 weeks to 1 week.