Distributed Systems Engineer| Streaming | Search | Saas
Current- Leading the Splunk native Ingest Processor's streaming runtime-- Cloud based distributed stream processors built from scratch (includes stateful processing and joins)-- Helping define Splunk language design spec for stream processors- Apache Pulsar (Open Source) for Splunk wide messaging as a service platform-- Contributed to Apache Bookkeeper Open source storage layer features- auto-scaling storage layer - Built a distributed KV store including Raft based consensus algorithm- Architected and developed "Formula builder" -- Domain Specific Language -- for Splunk Industrial Asset Intelligence product- Worked on Splunk search infrastructure and search language on distributed search algorithms/ language engineering for big data.- Machine learning/ deep learning for IoT edge analytics- Worked on Orchestration platform for Splunk security orchestration which is used to take actions on the data- Logging as service SaaS platform from scratch