Lead Software Engineer
Current⇨ Led the team to create a Spark-based computation engine to process millions of events to produce meaningful data for the customers to use downstream in customer segmentation⇨ Led the team in creating a distributed data ingress egress at edges Using Kafka that is capable of handling 300B+ messages per day for the Adobe Experience Platform⇨ Developed a near-real-time rate limiter to handle millions of events per second in a cluster https://experienceleaguecommunities.adobe.com/t5/adobe-experience-platform-blogs/rate-limiting-in-pipeline-high-quality-of-service-at-millions-of/ba-p/430940⇨ Grew the users of the Egress system from 10s to 100s within years⇨ Developed a modern deployment process for the microservices capable of deploying in 10's of location within hours which used to take days⇨ Leading a team in developing a compute engine that can handle billions of events using Spark and Spark SQL to provide insights into customer usage behavior
