Senior Software Engineer
CurrentAs an ELK Lead, I designed Logstash configurations to parse and enrich data, improving log management and analysis. I led Logstash deployments in Docker containers, ensuring seamless integration across environments.I developed monitoring solutions for Spark pipelines and Kafka metrics using Jolokia, JMX, SNMP, and Prometheus, providing real-time system insights. I also built monitoring frameworks with dashboards and automated incident management. Additionally, I proposed and executed an Elasticsearch data tier strategy, optimizing cluster performance and cost management.I trained data analysts, fostering growth and independence, while contributing to scalable data tier designs.As a Python Developer, I built monitoring solutions to improve ELK Stack performance and data retrieval. I developed a predictive model for HDFS disk usage in Spark pipelines, enabling proactive resource management. I created visualization tools to optimize retention policies, leading to cost savings, and wrote unit tests using pytest to ensure application reliability.In addition to backend, I developed dynamic frontend apps using NiceGUI, CSS, and HTML.With extensive ArgoCD experience, I automated CI/CD workflows and integrated it with GitHub for version control. I managed Helm charts for Kubernetes apps, including Grafana for monitoring.In Grafana, I integrated data sources, configured alerts, and customized dashboards. I used variables and templating for dynamic dashboards and automated their creation via the Grafana API. I also managed LDAP configurations and plugins for enhanced system monitoring.As a Knowledge Graph Engineer, I built scalable infrastructures using Anzo, Stardog, and Conweaver. I developed ontology models with domain experts, enabling dynamic querying through SPARQL, GraphQL, and OData APIs. I mentored junior engineers, facilitating knowledge transfer and team growth.