• Involved in many transformation projects on Hadoop/Spark from legacy ETL platform. I have worked on different projects like real time notification for Bank Transaction using Kafka and Spark. Enterprise Data. ET, ETL, ELT projects. • Extensively worked two Hadoop Platform upgrade projects. Recent one with HDP 2.6.4 to 2.6.5 where Major upgrade was with Kafka from 0.10.0 to 1.0 and Spark 2.2 to 2.3. I have worked on identification and RCA Spark Bug SPARK246307,SPARK-24865,SPARK-25051… Show more • Involved in many transformation projects on Hadoop/Spark from legacy ETL platform. I have worked on different projects like real time notification for Bank Transaction using Kafka and Spark. Enterprise Data. ET, ETL, ELT projects. • Extensively worked two Hadoop Platform upgrade projects. Recent one with HDP 2.6.4 to 2.6.5 where Major upgrade was with Kafka from 0.10.0 to 1.0 and Spark 2.2 to 2.3. I have worked on identification and RCA Spark Bug SPARK246307,SPARK-24865,SPARK-25051 and Patched applied for same bugs. Also work on identification and RCA Oozie – Spark Bug OOZIE-3440• Identified file-system utilization discrepancy and found that 5% space from the local file-system is being reserved. Each server has 12 disk of 4 TB file-systems . Total 116 Datanodes are in one cluster . By reducing the reserved space to 1%(which is also recommended for less chatty file-systems > 50 GB ) , we have saved about 2 TB of space per data-node and roughly overall 232 TB of space across one cluster . Which is 14% storages saving without additional cost . • I developed a comprehensive Cluster Health Checks Script which is use daily for 13 clusters health checks and Daily Dashboard preparation. Script has reduced 4 hrs manual efforts to 1 hr per day. Script is used by On Call person during Call Out plus during any change implementation pre and post check • Setting up Elasticsearch, Logstash, and Kibana (ELK) stack for monitoring for Hadoop Cluster , Batch Jobs. Show less

Key Achievements • Involved in many transformation projects on Hadoop/Spark from legacy ETL platform. I have worked on different projects like real time notification for Bank Transaction using Kafka and Spark. Enterprise Data. ET, ETL, ELT projects. • Extensively worked two Hadoop Platform upgrade projects. Recent one with HDP 2.6.4 to 2.6.5 where Major upgrade was with Kafka from 0.10.0 to 1.0 and Spark 2.2 to 2.3. I have worked on identification and RCA Spark Bug… Show more Key Achievements • Involved in many transformation projects on Hadoop/Spark from legacy ETL platform. I have worked on different projects like real time notification for Bank Transaction using Kafka and Spark. Enterprise Data. ET, ETL, ELT projects. • Extensively worked two Hadoop Platform upgrade projects. Recent one with HDP 2.6.4 to 2.6.5 where Major upgrade was with Kafka from 0.10.0 to 1.0 and Spark 2.2 to 2.3. I have worked on identification and RCA Spark Bug SPARK-246307,SPARK-24865,SPARK-25051 and Patched applied for same bugs. Also work on identification and RCA Oozie – Spark Bug OOZIE-3440• Identified file-system utilization discrepancy and found that 5% space from the local file-system is being reserved. Each server has 12 disk of 4 TB file-systems . Total 116 Datanodes are in one cluster . By reducing the reserved space to 1%(which is also recommended for less chatty file-systems > 50 GB ) , we have saved about 2 TB of space per data-node and roughly overall 232 TB of space across one cluster . Which is 14% storages saving without additional cost . • We developed a comprehensive Cluster Health Checks Script which is use daily for 13 clusters health checks and Daily Dashboard preparation. Script has reduced 4 hrs manual efforts to 1 hr per day. Script is used by On Call person during Call Out plus during any change implementation pre and post check • Setting up Elasticsearch, Logstash, and Kibana (ELK) stack for monitoring for Hadoop Cluster , Batch Jobs.• Performance and Capacity planning for Hadoop cluster • Automated various Cluster activities using API and Python Scripting.• Built two Eupore’s largest Hortonworks HDP clusters to meet growing demand of a Bank’s Big Data Analytics, Batch Processing and Regulatory Requirements. • Large scale Hadoop Clusters Auditing, Documenting findings & Performance tuning and Bug Fixing . • Knox configuration for different service endpoint• 6 month work experience in GCP Cloud for Dataproc POC Show less

Task • Worked on large scale UNIX estate maintenance and support for one UK’s largest financial institute . Key Achievements • Worked on deputation in UK to manage customer relationship.

Key Achievements • Managed Unix related support and OS migration work in capacity of a Unix/Linux expert, OS migration work. • Awarded Star performer for the works on knowledge sharing with other team member on Unix. And preparing of SOP / procedure documents for UNIX related work.

Key Achievements • As fresher gain knowledge on Enterprise Unix like IBM AIX, RED HAT Linux. Promoted to customer focal point for multiple accounts