Distinguished Engineer
Current- Led the design and implementation of a scalable, microservice-based architecture for a delivery industry application, using NATS as the primary message-passing system for more than 125 clients and delivering more than 300k messages per second.- Setup Machine learning pipelines using classical and neural network algorithms on Kubernetes to reduce resource usage and increase the data gathering by 10%.- Lunch Kubernetes pods periodically using Airflow for data processing.- Setup… Show more - Led the design and implementation of a scalable, microservice-based architecture for a delivery industry application, using NATS as the primary message-passing system for more than 125 clients and delivering more than 300k messages per second.- Setup Machine learning pipelines using classical and neural network algorithms on Kubernetes to reduce resource usage and increase the data gathering by 10%.- Lunch Kubernetes pods periodically using Airflow for data processing.- Setup Seldon for Data science team so they can serve their models easily and without getting help from Dev team.- Write data ingestion pipelines using Apache Spark and Apache Beam in Java.- Deploy Kafka on Kubernetes using Strimzi.- Mentoring teams for effective use of NATS and other messaging systems. Show less