Nikhith Kudumula Email & Phone Number

Bengaluru, Karnataka, India

At Onclusive, I am responsible for designing and implementing cloud-based streaming and batch data pipelines to process public media and public relations data at scale. I work on building a comprehensive Data Lake for article and publication analysis, driving both real-time and batch processing solutions using Apache Beam, Flink, Kubernetes, and Apache Kafka.Key Responsibilities and Achievements:Designed and implemented cloud-based streaming frameworks to process millions of… Show more At Onclusive, I am responsible for designing and implementing cloud-based streaming and batch data pipelines to process public media and public relations data at scale. I work on building a comprehensive Data Lake for article and publication analysis, driving both real-time and batch processing solutions using Apache Beam, Flink, Kubernetes, and Apache Kafka.Key Responsibilities and Achievements:Designed and implemented cloud-based streaming frameworks to process millions of records in real time, enabling faster insights and decision-making for media and PR data.Built batch pipelines for large-scale data processing, ensuring scalability, reliability, and efficiency.Orchestrated data workflows using Apache NiFi in Kubernetes, enabling seamless integration and transformation of media data into usable formats.Optimized query performance in Data Lakes to reduce latency and improve the overall throughput of the system.Led the transition from legacy AWS Lambda architecture to a distributed model with Apache Flink, Docker, and Kubernetes, improving system scalability and operational efficiency.Managed and scaled containerized applications through Amazon ECR, contributing to the scalability of Elasticsearch clusters in EKS for fast data search and retrieval.Designed and implemented real-time deployment platforms for Beam Flink clusters on Kubernetes, integrating with Kafka for seamless data streaming and processing.Leveraged FluxCD for GitOps-based automation and deployment of both batch and streaming data pipelines, ensuring consistency across environments.This role allows me to combine my passion for data engineering, cloud technologies, and scalable architectures, while driving forward innovative solutions that support public relations and media intelligence at a global scale. Show less

Bengaluru, Karnataka, India

Hyderabad, Telangana, India

Hyderabad, Telangana, India

At DBS, I designed and implemented data engineering solutions to facilitate the migration of large volumes of data from Oracle to a Data Lake. I focused on building highly efficient and scalable batch processing and data ingestion pipelines using Apache NiFi and Apache Spark, enabling faster data processing and insights.Key Responsibilities and Achievements:Designed and implemented metadata-driven frameworks for seamless data migration from Oracle to a Data Lake, ensuring smooth… Show more At DBS, I designed and implemented data engineering solutions to facilitate the migration of large volumes of data from Oracle to a Data Lake. I focused on building highly efficient and scalable batch processing and data ingestion pipelines using Apache NiFi and Apache Spark, enabling faster data processing and insights.Key Responsibilities and Achievements:Designed and implemented metadata-driven frameworks for seamless data migration from Oracle to a Data Lake, ensuring smooth transition and reducing manual intervention.Developed and optimized batch ingestion pipelines using Apache NiFi, Spark, and HDFS to process various data sources and file formats efficiently.Managed over 9000 Spark jobs in a shared context, ensuring optimized resource usage and faster processing.Built and implemented a computation component for metadata mapping, loading data into target tables efficiently and enabling streamlined data transformations.Improved performance by caching frequently used data and reducing the need for repetitive computations across multiple jobs.Implemented data lineage tracking to provide transparency and better understanding of data flows across systems, supporting business-critical decision-making.Automated code deployment and data pipeline orchestration using Jenkins, ensuring smooth and continuous integration of new features and bug fixes.Conducted a POC for GPU-accelerated Spark jobs, exploring new technologies to enhance processing speeds.Collaborated with cross-functional teams to ensure efficient data processing, storage, and consumption, contributing to the success of the overall data infrastructure at DBS.This role allowed me to drive significant improvements in data processing performance, automate workflows, and scale data pipelines to meet the growing demands of a large financial institution. Show less

Hyderabad, Telangana, India

Hyderabad Area, India

Mysuru Area, India

Bachelor Of Technology (Btech), Computer Science, 6.99

Higher Secondary School(Intermidiate), Mathematics, 86.1