Software Engineer - Data
Current-> Managing and supporting data pipelines implementing Change Data Capture (CDC) to replicate data into analytic warehouses such as Google BigQuery, Snowflake, and Databricks.-> Acting as the single point of contact (SPOC) for maintaining and troubleshooting the Databricks connector, ensuring system reliability and quick issue resolution.-> Primarily focused on supporting and enhancing existing pipelines, with a strong emphasis on bug fixes and performance improvements.-> Contributed to Databricks partner certification, aiding in the organization’s partnership standing through technical support and guidance.-> Optimized pipelines for better performance and near real-time data synchronization across systems, addressing issues and refining processes.-> Developed solutions for seamless data integration and reporting when needed, leveraging Java and cloud technologies.-> Played a key role in feature support, ensuring the ETL pipelines to GBQ, Snowflake, and Databricks function smoothly.-> Mentored new team members, helping them navigate the technology stack and ensuring a smooth onboarding process.