Puviarasu Senthilkumar Email & Phone Number

Euless, Tx, Us

Euless, Tx, Us

Cayman Islands

Cayman Islands

Developing and maintaining configurable data pipelines for Healthcare clients using Azure Databricks, MongoDB, Scala.

Coimbatore Area, India

As a Senior Software Engineer at Robert Bosch Engineering and Business Solutions, I played a pivotal role in developing a batch solution initially for Manufacturing Execution System (MES) and transforming the batch to streaming solution. Here's how I contributed to this impactful project:🚀 Project Overview:- Reduced latency and improved data completeness and performance of the existing MES Batch solution by implementing Spark Structured Streaming.- Enabled near real-time visualization of the production process, enhancing decision-making capabilities.- Developed a generic solution that caters to multiple production plants globally.🌟 Key Achievements:- Migrated multiple pipelines across different manufacturing plants, with ongoing migration efforts in other locations.- Converted MES batch logic into Spark Structured Streaming jobs, leveraging Spark 2.4.0 and Cloudera CDH6.- Designed and implemented Spark Structured Streaming pipelines tailored for MES data.- Created MES Batch jobs to efficiently merge small files, optimizing data processing.- Tuned the performance of continuous Spark jobs to ensure data processing within desired time intervals.- Adopted a functional programming style in Scala for streamlined development.- Rolled out and maintained pipelines in multiple plants, ensuring seamless operations.- Generalized the solution to make it compatible with different clusters, enhancing scalability.- Developed Linux shell scripts and Python scripts for automated deployment and scheduling of Spark jobs in clusters.- Crafted Hive views with custom logic to meet specific plant requirements.- Implemented automated scripts to refresh Impala data, keeping it up to date.

Chennai, Tamil Nadu, India

During my tenure as a Software Developer at Cognizant Technology Solutions, I contributed to a range of projects aimed at optimizing data transfer, analytics, and application integration. Here's an overview of my responsibilities and contribution across these projects:🚀 Project Portfolio:Project 3: Bulk Transfer Tool EnhancementDescription: Developed a solution to transfer vast volumes of data between the Alfresco system and independent user machines worldwide, utilizing various applications.Contributions:- Conducted an in-depth analysis of the existing system's performance.- Explored alternative approaches to enhance the current implementation.- Implemented enhancements and performed unit testing with JUnit.- Ensured periodic Jenkins builds and maintained code quality control.Project 2: Global Analytics and ReportingDescription: Designed and implemented a system to perform analytics on logs generated from data and cache servers across the globe, presenting the results in graphical formats.Contributions:- Created complex ElasticSearch queries and aggregations in Java for efficient data analysis.- Developed Spring RESTful web services to support the user interface.- Conducted unit testing with JUnit and seamlessly integrated services with the UI.- Oversaw periodic Jenkins builds to ensure code quality and reliability.Project 1: International Player Management SystemDescription: Integrated a web-based application for managing international baseball players and trainers within the organization.Contributions:- Developed dynamic UI widgets using jQuery to enhance user experience.- Implemented business logic in Java and exposed it as Jersey RESTful web services.- Facilitated seamless integration of services with the user interface.- Maintained database integrity through periodic Liquibase builds and upheld code quality control via Jenkins builds.