Rachapalli Sai Sushanth Reddy Email & Phone Number

Utilized Kafka for the purpose of activity tracking as well as log aggregation.• Skilled in the use of Spark Core, Spark SQL, Spark MLlib, Spark GraphX, and Spark Streaming to process and transform complex data using in-memory computing capabilities built in Scala. I worked with Spark to make existing algorithms more efficient by leveraging Spark Context, Spark SQL, Spark MLlib, Data Frame, Pair RDD's, and Spark YARN.• Experience in designing and implementing complex PL/SQL code to manage healthcare-related data.• Implemented AWS Step functions to automate and orchestrate the Amazon Sagemaker related tasks such as publishing data into S3,training ML model and deploying it.• Designed and implemented serverless ETL pipelines using AWS Glue to automate data ETL processes for healthcare data sources. • Implemented and managed AWS Glue Data Catalog and Created custom classifiers and schema evolution scripts.• Utilized Sqoop export/import to extract the data from Teradata and MySQL and place it in HDFS.• Experience in developing interactive analysis, batch processing, and stream processing applications using PySpark and Spark-Scala is a valuable skill.• Designed and development of data integration solutions using Ab Initio ETL tool to consolidate patient data from sources.• Used Terraform for creating infrastructure as code, managed AWS resources and maintained consistency across environments.

India

. Provisioned Kubernetes clusters on Amazon Web Services (AWS) using Docker, Ansible, and Terraform in order to develop various application environments, as well as generate and test those environments.. Used Sqoop to extract files from MongoDB and placed them in HDFS, where they were then processed.Experience in designing and developing production-ready data processing applications in Spark utilizing Scala and Python. . Strong expertise developing Spark applications for the purpose of carrying out a variety of data transformations, such as data cleansing, de-normalization, a variety of joins, data aggregations, etc. . Participated significantly in the process of developing PL/SQL objects, such as procedures, functions, and packages.. Assisted with the loading of data into HDFS after managing the importation of data from a variety of data sources, using Spark to do data control checks, and loading the data.Excellent knowledge of NoSQL databases as well as hands-on experience in the development of apps that run on NoSQL databases such as HBase, Cassandra, and MongoDB. . Constructed a number of Spark applications and Hive scripts in order to generate a variety of analytical datasets that are required by digital marketing teams. . Involved mostly in Data Migration with SQL, SQL Azure, Azure Storage, and Azure Data Factory along with SSIS and PowerShell. . Integrated Apache Airflow with AWS to monitor multistage ML workflows with the tasks running on AWS.. Used Terraform I optimized data workflows to meet industry-specific compliance requirements and with secure handling of sensitive information.. Architect and implement business intelligence solutions on Azure leveraging the services of the Azure Data Platform (Azure Data Lake, Data Factory, Data Lake Analytics, Stream Analytics, Azure SQL DW, HDInsight/Databricks, and NoSQL DB).

India

. Collaborated with Data engineers and the operation team to create an ETL process and Snowflake models, as well as write and optimize SQL queries to accomplish data extraction to match the analytical requirements.. Developed Tableau reports that included complex calculations, and worked on Ad-hoc reporting projects using Power BI. . Strong expertise developing Spark applications for the purpose of carrying out various types of data transformations, such as data cleansing, de-normalization, various kinds of joins, data aggregations, and so on.. Pipelines based on PySpark were developed, and spark data frame operations were used to load data into EDL. Jobs were run on EMR, and AWS S3 was used as the storage layer.Integrated Apache Airflow with AWS in order to monitor multi-stage workflows involving Amazon Sage Maker jobs.. Proficient in the use of Spark Core, Spark SQL, Spark MLlib, Spark GraphX, and Spark Streaming for the purpose of processing and manipulating complicated data using in-memory computing capabilities written in Scala. . Worked with Spark to make current algorithms more efficient by leveraging Spark Context, Spark SQL, Spark MLlib, Data Frame, Pair RDD's, and Spark YARN.. Utilizing Sqoop export/import, we were able to extract the data from Teradata and MySQL and place it in HDFS.. Knowledge and skill in combining Hive and HBase for efficient business operations. Worked in a workplace based on scrum and agile, using tools such as JIRA.

Master'S Degree, Data Science

Bachelor Of Engineering, Electrical, Electronics And Communications Engineering