Software Engineer
Current- Transitioned from a paid Ambari Managed Hadoop Cluster to a cost-effective self-managed solution.- Implemented Hadoop High Availability on HBase for improved system resilience.- Migrated data from an outdated HBase cluster to a modern environment.- Automated cluster maintenance with Ansible scripts, reducing manual workload.- Developed cost-effective Java code for AWS Lambda, triggered by SQS queue messages.- Utilized Solr for efficient searching and indexing across ARC ecosystem products.- Revitalized a decade-old codebase, including upgrading libraries and creating RabbitMQ, Redis, and MySQL clusters.- Single-handedly updated old libraries to remove vulnerable jars, transitioning from an Ant project to a Spring Boot project, resulting in a complete project overhaul.- Developed a Spring Boot-based monitoring tool to enhance team efficiency and database access.- Conducted R&D on JanusGraph, developed Java Spring Boot code for MySQL data migration, and worked with Gremlin queries.- Worked on Elasticsearch to create optimized data mappings for retrieval and storage.- Set up backup and restore scripts for HBase.- Set up Solr by using external Zookeeper quorum and implement backup and restore scripts.- Created bash scripts to streamline cluster start/stop operations for easier maintenance and server reboots.- Leveraged AI tools to expedite workflows and improve efficiency.- Implemented Ansible scripts for common tasks across all servers, enhancing automation and consistency.
