• Implemented a scalable unified solution for efficient storage, search, reporting, and monitoring of a large volume and variety of log data.• Deployed, configured, and maintained Hortonworks Data Platform.• Streamlined data integration with NiFi, reducing pipeline development time by 50%.• Integrated Elasticsearch and Kibana for efficient search, monitoring, and visualization.• Implemented Kafka for fault-tolerant log data ingestion.• Integrated Spark Streaming with Kafka… Show more • Implemented a scalable unified solution for efficient storage, search, reporting, and monitoring of a large volume and variety of log data.• Deployed, configured, and maintained Hortonworks Data Platform.• Streamlined data integration with NiFi, reducing pipeline development time by 50%.• Integrated Elasticsearch and Kibana for efficient search, monitoring, and visualization.• Implemented Kafka for fault-tolerant log data ingestion.• Integrated Spark Streaming with Kafka for data enrichment in batch.• Leveraged SparkSQL for advanced aggregations and analysis.• Designed Hive tables and queries to facilitate log data retrieval and analysis.• Deployed Kafka Connect and Rsyslog, enabling real-time data ingestion.• Contributed to relational log database migration, improving scalability and accessibility.• Collaborated with cross-functional teams to gather needs and design data solutions. Show less

• Technical leadership and mentoring for development teams and new hires.• Worked in the framework team to enhance components and implement new features.• Optimized report queries for improved performance.• Developed and enhanced table schemas, functions, and stored procedures in SQL Server.• Created customized BI reports and dashboards to meet customer needs.• Analyzed, debugged, and tested reported issues and development team requirements.• Collaboration with testing… Show more • Technical leadership and mentoring for development teams and new hires.• Worked in the framework team to enhance components and implement new features.• Optimized report queries for improved performance.• Developed and enhanced table schemas, functions, and stored procedures in SQL Server.• Created customized BI reports and dashboards to meet customer needs.• Analyzed, debugged, and tested reported issues and development team requirements.• Collaboration with testing team to create testing scenarios for new features.• Worked in the analytic team to gather customer requirements.• Worked in the development team to implement requirements.• Implemented Document and Image Archive System.• Participated in the implementation of CRM, Ticketing, and Issue Management Systems.• Provided on-site customer support, including training and troubleshooting.• Deployed and configured SQL Server, IIS, and in-house framework for customer infrastructures. Show less