Software Development Engineer Iii
Current◦ Utilized an external API to extract provider directory data, which was then processed, aggregated, and cached within MongoDB with Redis on top, which resulted in a 75% decrease in response time(p99). Developed a scheduled task to automatically retrieve updates from the remote source at regular intervals, ensuring that the local MongoDB cache remains up-to-date.◦ Engineered and implemented an optimized search system, leveraging indexing techniques and the MongoDB aggregation pipeline.◦ Designed and developed a high-throughput logging system that processes over 4 billion logs monthly. Utilized Kafka and MySQL for data processing and storage, implementing asynchronous processing techniques to minimize system overhead and optimize performance.