With over four years of experience in data engineering and distributed systems, I specialize in building and optimizing large-scale data pipelines and enhancing search and analytics functionalities. At Brane Enterprises, I led the development of a process mining pipeline using Apache Kafka and Flink, significantly improving process visibility and reducing processing time by 30%. I’ve also designed and implemented end-to-end pipelines, including a Kafka to Druid integration that increased data retrieval speed by 40%, and a Kafka to Elasticsearch pipeline that boosted search efficiency, reducing query execution time for OLAP needs by 25%.My expertise in Elasticsearch extends to enhancing search capabilities with shard replication strategies, improving both query reliability and latency. Additionally, I developed a Notifications Service that utilizes Kafka, Spring Boot, and Firebase for real-time multi-channel notifications, increasing user engagement and streamlining communication.In supporting infrastructure and automation, I’ve optimized data storage and retrieval across PostgreSQL, MongoDB, and Druid, and deployed Python DAGs for job scheduling with Airflow and Jenkins, cutting down manual intervention by 50%. Known for consistently delivering robust solutions, I am committed to building scalable, efficient systems that drive business value.In a recent project, I contributed to the development of a No-code UI Builder using Java and Flutter to enable quick, customizable user interface designs.