Technology Associate
Current- Engineered a priority-aware data pipeline using Kafka, processing over 600,000 messages daily. This solution accelerated priority data availability, saving up to 5 hours on critical days thus enabling timely daily.
- Designed and implemented an exception-driven workflow using Java, Elastic, Snowflake and AWS based architecture, effectively capturing and resolving discrepancies totaling over $20 million in firmwide P&L.
- Set up a scalable ETL pipeline on AWS using Glue, S3, Lambda, SQS, and Kafka to migrate 100 million daily on-prem P&L records to Snowflake. This migration co-located data for faster, more scalable queries and.
- Led the migration of a P&L sign-off workflow, managing daily P&L for firmwide traders, from a legacy email-based system to strategic internal platforms leveraging S3 and Kafka. This transition reduced P&L report render.
- Developed a robust framework for active monitoring and alerting of critical services, utilizing custom-defined SLOs and tools like Prometheus. This initiative led to a significant reduction in severe incidents and a.
- Designed and decoupled critical P&L transferring data pipes using Kafka for the legacy and the strategic data sources enhancing availability and significantly reducing operational costs.
Jan 2024 - Present
