Rajesh Reddy P Email & Phone Number

Omaha, Nebraska, United States

Plano, Texas, United States

• Worked on Schema mapping/Conversion as part of Integration and Consumption team.• Generated reports for Business team buy identifying Critical Data Elements.• Used Azure Data Factory V2 to integrate with OnPrem cluster and scheduled data import to Azure Data Lake Store.• Used U-SQL, PowerShell to process data in ADLS.• Used Control-M to atomate jobs to run daily using PowerShell scripts. Scheduled Azure SQL DW to Start/Pause using Azure Runbook notebook.• Implemented a hybrid cloud solution using Azure Databricks to support noncritical batch analytics.• Worked on creating a baseline POCs for different Data warehousing scenario's using stored procs on MS SQL DW on Azure environment.• Acquired business, domain knowledge from respective teams of Transamerica and developed data Consumption views with CDE’s (critical data elements).

Neenah, Wisconsin, United States

• Managed Hadoop cluster with 29 nodes having HDP(Hortonworks) distribution using Ambari and HDP 2.6 leveraging the cloud environment from Microsoft Azure.• Used a tool called CloudBreak for provisioning and managing Apache Hadoop clusters on Microsoft Azure.• Monitored cluster for performance, networking, and data integrity issues. Responsible for troubleshooting issues in the execution of MapReduce jobs by inspecting and reviewing log files.• Formulated procedures for installation of Hadoop patches, updates, and version upgrades.• Installed and configured Tableau Desktop to connect to the Hortonworks Hive Framework (Database) which contains the click stream data from Mixpanel and Google Analytics.• Used Apache Nifi for ingestion of data from Mixpanel API on to HDFS in raw JSON format.• Developed optimal strategies for distributing the click stream data over the cluster by importing the data into HDFS through connecting to the Mixpanel, Google Analytics API.• Developed custom shell scripts to connect to the Mixpanel and Google Analytics API and used Crontab for scheduling purposes.• Developed hive tables on top of the consumed JSON data from Mixpanel API and stored them in ORC format for optimized querying in tableau. • Used custom shell scripts to convert the Google Analytics data format(dic) to JSON and then dumped it on HDFS for further analytics.

Jacksonville, Florida, United States

• Collected and aggregated large amounts of data from different sources such as COSMA (CSX Onboard System Management Agent), BOMR (Back Office Message Router), ITCM (Interoperable train control messaging), Onboard mobile and network devices from the PTC (Positive Train Control) network using Apache Nifi and stored the data into HDFS for analysis.• Used Apache Nifi for ingestion of data from the IBM MQ’s (Messages Queue).• Implemented Nifi flow topologies to perform cleansing operations before moving data into HDFS.• Developed optimal strategies for distributing the ITCM log data over the cluster; importing and exporting the stored log data into HDFS and Hive using Apache Nifi.• Developed custom code to read messages of IBM MQ and to dump them onto the Nifi Queues.• Worked with Apache Nifi flow to perform conversion of Raw XML data into JSON, AVRO.• Installed and configured Tableau Desktop to connect to the Hortonworks Hive Framework (Database) which contains the Bandwidth data from the locomotive through the Hortonworks ODBC connector for further analytics of the data.• Collected and provided locomotive communication usage data by locomotive, channel, protocol and by application.• Analyzed the Locomotive Communication Usage from COSMA to monitor in/out-bound traffic bandwidth by communication channel.• Worked on back-end Hive database to provide both Historical and live Bandwidth data from locomotives to tableau for historical and live reporting.

Houston, Texas, United States

• Installed and configured a three-node cluster with Hortonworks Data Platform (HDP 2.3) on the HP infrastructure and Management.• Worked with HP Intelligent provisioning and the smart storage array for setting up the disks for the installation.• Used a Big Data Benchmark tool called BigBench to benchmark the three-node cluster.• Configured the tool BigBench and had it running on one of the nodes in the cluster.• Ran the Benchmark for different Datasets of 5GB, 10GB, 50 GB, 100 GB and 1 TB.• Worked with structured, semi-structured and unstructured data which is automated in the tool BigBench having to run with the workloads using Spark’s machine learning libraries.• Configured a PAT (Performance Analysis Tool) for having the benchmark results dumped into the automated charts using MS-Excel.• Used Ambari Server for monitoring the cluster while the benchmark is running.• Worked with different teams to install operating system, Hadoop updates, patches, version upgrades of Hortonworks as required.• Collected the performance metrics from Hadoop nodes, to analyze the resource utilization and draw automated charts using MS-Excel, a Performance Analysis Tool (PAT) was used.• Worked with various performance monitoring tools like top, dstat, atop and also Ambari metrics.• Collected the results from the different Datasets (5GB, 10GB, 50GB, 100GB and 1TB) tests on the Server and was able to dump them on to the PAT (Performance Analysis Tool) for further analyzing the resource utilization.

Sarnia, Ontario, Canada

• Installed and configured mobile devices• Created documentation for mobile devices of all platforms (Android, Apple etc.)• Configured and deployed new computers, monitors, hardware peripherals, multimedia hardware, printers, and mobile devices• Installed and configured software images, and specialty software on computers and mobile devices• Responsible for understanding the scope of the documentation and requirement gathering.• Created & documented Test Strategy, scenarios and procedures.

Provided technical support and customer service for the clients of DISH network (one of the major television providers in the USA).. Resolved Customers Issues(Technical issues, Troubleshooting issues) Maintained Good CSAT(Customer Satisfaction) throughout my tenure

Master'S Degree, Computer Science, 3.5

Post Graduate, Information Technology And Web Design, 3.68

Bachelor'S Degree, Electronics And Communications Engineering, 3.5