Lakshmi V is a Data Engineer at Medica Group.
-
Data EngineerMedica GroupUnited States -
Sr. Kafka DeveloperMarsh Mclennan Mar 2022 - PresentUnited States• Designed and implemented event-driven architectures using the Confluent Event Streaming Platform (Confluent Kafka/Confluent Cloud).• Utilized Schema Registry to enforce data serialization formats such as Avro and JSON across producers and consumers.• Configured and managed Kafka Connectors, including JDBC and FileStream connectors, to streamline integrations with Oracle databases and AWS S3.• Developed KSQL queries for real-time data aggregation, filtering, and transformation to support analytics pipelines.• Built and deployed containerized Kafka-based microservices using Kubernetes and OpenShift, ensuring high availability and scalability.• Automated Kafka cluster provisioning and management using Terraform and Ansible for seamless infrastructure as code (IaC).• Implemented role-based access control (RBAC) and encrypted communications (SASL_SSL) for secure Kafka environments.• Installed, configured, and maintained Confluent Kafka and Apache Kafka clusters on Linux and AWS EC2, ensuring high availability and fault tolerance.• Developed microservices using Spring Boot integrated with Kafka, adhering to event-driven architecture for seamless communication.• Integrated Schema Registry to enforce schema validation and maintain compatibility between Kafka producers and consumers.• Implemented KSQL DB for real-time stream processing and querying of Kafka topics to support business use cases.• Managed Confluent Kafka connectors for JDBC and Debezium for real-time data ingestion from Oracle and MySQL.• Configured and managed Kafka Connectors for Oracle Source and Sink, enabling robust data ingestion and processing pipelines. -
Sr. Kafka EngineerBank Of America Jul 2020 - Feb 2022Dallas, Texas, United States• Architected and deployed streaming pipelines using Confluent Kafka, leveraging KSQL DB for real-time transformations and analytics.• Configured Schema Registry to manage Avro schemas and ensured compatibility between evolving producer-consumer applications.• Designed high-throughput, low-latency Kafka Streams applications to process financial transactions in real time.• Integrated Kafka Connect with AWS services such as S3 and RDS, enabling seamless data migration and synchronization.• Deployed Kafka brokers and Zookeeper on Kubernetes (EKS), implementing auto-scaling policies for peak traffic handling.• Developed CI/CD pipelines using Jenkins and GitOps for automated testing and deployment of Kafka microservices.• Designed and executed disaster recovery (DR) strategies for Kafka clusters, including multi-region replication.• Optimized Kafka producer and consumer configurations to achieve sub-second latency for high-traffic applications.• Architected and deployed Kafka solutions on AWS MSK, ensuring secure and scalable messaging infrastructure for high-volume enterprise applications.• Built and maintained real-time streaming pipelines using Kafka Streams and Apache Flink, delivering optimized data flow and processing.• Developed microservices using Spring Boot, integrated with Kafka for an event-driven design, ensuring modularity and scalability.• Configured and managed Confluent Kafka Schema Registry to enforce schema compatibility for Avro and JSON data formats.• Developed and deployed KSQL DB queries for transforming and filtering data streams in real-time.• Configured Kubernetes (EKS) clusters to manage Kafka brokers, auto-scaling strategies, and resource optimization. -
Kafka DeveloperCharter Communications Dec 2018 - Jun 2020Englewood, Colorado, United States• Architected and deployed streaming pipelines using Confluent Kafka, leveraging KSQL DB for real-time transformations and analytics.• Configured Schema Registry to manage Avro schemas and ensured compatibility between evolving producer-consumer applications.• Designed high-throughput, low-latency Kafka Streams applications to process financial transactions in real time.• Integrated Kafka Connect with AWS services such as S3 and RDS, enabling seamless data migration and synchronization.• Deployed Kafka brokers and Zookeeper on Kubernetes (EKS), implementing auto-scaling policies for peak traffic handling.• Developed CI/CD pipelines using Jenkins and GitOps for automated testing and deployment of Kafka microservices.• Engineered real-time data streaming pipelines using Kafka and integrated them with Spring Boot microservices for event-driven systems.• Deployed and managed Kafka clusters on AWS MSK and orchestrated services using Kubernetes (EKS) for scalability and fault tolerance.• Developed Kafka Streams applications for data transformation and analytics, leveraging KSQL for real-time queries.• Implemented and optimized Kafka Connect connectors for JDBC and HDFS to ensure seamless data pipeline creation.• Configured Kafka Producers and Consumers for low-latency data processing, optimizing end-to-end data workflows.• Integrated Schema Registry to enforce schema evolution and compatibility for streaming applications.• Configured Kafka brokers and Zookeeper instances on OpenShift using the Strimzi Kafka Operator, simplifying cluster management.• Designed and deployed Kafka Streams applications that utilized KSQL for business-critical metrics and insights.• Automated infrastructure provisioning using Terraform and CI/CD pipelines with Jenkins, streamlining deployment processes -
Java DeveloperVolute May 2017 - Nov 2018Rhode Island, United States• Developed Kafka producers and consumers for processing streaming data, ensuring low-latency analytics pipelines.• Designed and implemented ETL workflows using Apache Kafka, integrating data from diverse sources like Google Cloud Pub/Sub.• Deployed containerized applications using Kubernetes to manage and orchestrate Kafka and Spring Boot components.• Built CI/CD pipelines with Jenkins, automating build and deployment for Java-based microservices.• Used Kafka Streams and KSQL for real-time data transformation and aggregation, reducing processing delays by 40%.• Collaborated with the team to configure Kafka Schema Registry for managing Avro data formats in messaging workflows.• Integrated Kafka with GCP services like Compute Engine and Cloud Storage for scalable, cloud-native solutions.• Enhanced Kafka monitoring capabilities using custom scripts and metrics dashboards on Grafana and Kibana.• Engaged in the SDLC phases, focusing on designing and developing enterprise-level Java applications, with a strong emphasis on cloud-based solutions.• Designed and implemented ETL processes using Apache Kafka, facilitating seamless data integration and real-time analytics.• Developed and deployed RESTful Web Services using Spring Boot, enabling efficient communication between distributed systems and external APIs.• Created Kafka producer and consumer applications to process real-time streaming data, optimizing data flow and ensuring low-latency processing.• Integrated Kafka with Google Cloud Platform (GCP) services, leveraging Pub/Sub for enhanced messaging and real-time processing capabilities. -
Java/J2Ee DeveloperAmtex Systems Inc. Mar 2014 - Dec 2016Hyderabad, Telangana, India• Interacted with the database team using JDBC. Maintained Spring Framework's IoC container configuration. Developed an internal browser-based text editor with HTML, Ajax, CSS, JavaScript, and jQuery.• Designed and implemented REST APIs to establish connections with various vendor websites.• Performed testing using JUnit and tested various test cases using Selenium and on service providers like Sauce Labs and Browser Stack. Tested the RESTful Services using Webpage by using XML and JSON format.• Installed, configured, and hosted Oracle, Tomcat app servers, and Cassandra DB servers on physical servers (Linux, Windows) and Amazon AWS virtual servers (Linux). Built and deployed Microservice applications using AWS Stack, including S3, EC2, Aurora, Kinesis, SNS, and SQS.• Performed data storage on AWS using AWS RDS feature and used Oracle 11G as a database for transactions.• Participated in development of a well responsive single page application using AngularJS framework, JavaScript, and jQuery in conjunction with HTML5, CSS3 standards, with front-end UI team.• Created reusable components and services in TypeScript to consume REST API's using a Component-based architecture provided by AngularJS.• Used jQuery, AngularJS and Node.js to develop the rich user interface and to invoke RESTful Web Services to perform various operations.
Lakshmi V Education Details
-
Computer Science
Frequently Asked Questions about Lakshmi V
What company does Lakshmi V work for?
Lakshmi V works for Medica Group
What is Lakshmi V's role at the current company?
Lakshmi V's current role is Data Engineer.
What schools did Lakshmi V attend?
Lakshmi V attended Gitam Deemed University.
Who are Lakshmi V's colleagues?
Lakshmi V's colleagues are Samantha Campbell, Rabin Chakraborty, Susan House, Fatih Muslu, Stephen Scales, Yara Mohamed, Jenna Thompsett.
Not the Lakshmi V you were looking for?
Free Chrome Extension
Find emails, phones & company data instantly
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial