Krishna Paruchuri Email & Phone Number

Minneapolis, Minnesota, United States

• Proficient in utilizing Apache Druid for real-time processing and analysis of healthcare data, ensuring immediate access to critical patient information• Knowledge of maintaining HIPAA compliance and securing real-time healthcare data within Apache Druid, ensuring patient privacy and data integrity.• Proficient in integrating Apache Druid with EHR systems to provide real-time access to patient records and support seamless patient care Created a DQA framework to check the data quality of daily feeds and reposit all DQ results into Metadata Hub. Migrated data to cloud storage ADLS2 using Abintio

Pataskala, Ohio, United States

 Involved in analyzing business requirements and prepared detailed specifications that follow project guidelines required for project development. Written Terraform scripts to automate AWS services which include ELB, CloudFront distribution, RDS, EC2, database security groups, Route 53, VPC, Subnets, Security Groups, and S3 Bucket and converted existing AWS infrastructure to AWS Lambda deployed via Terraform and AWS CloudFormation. Used Pyspark for data frames, ETL, Data Mapping, Transformation and Loading in complex and high-volume environment Extensively worked with Avro and Parquet, XML, JSON files and converted the data from either formatParsed Semi Structured JSON data and converted to Parquet using Data Frames in PySpark. Implemented scheduled downtime for non-prod servers for optimizing AWS pricing. Analyzed the system for new enhancements/functionalities and perform Impact analysis of the application for implementing ETL changes. Process the data from Kafka pipelines from topics and show the real time streaming in dashboards

Pataskala, Ohio, United States

Scottsdale, Arizona, United States

 Used Spark-Streaming APIs to perform necessary transformations and actions on the fly for building the common learner data model which gets the data from Kafka in near real time and Persists into Cassandra. Developed Autosys scripts to schedule the Kafka streaming and batch job. Optimizing of existing algorithms in Hadoop using Spark Context, Spark-SQL, Data Frames and Pair RDD's. Developed Spark applications using PySpark and Spark-SQL for data extraction, transformation and aggregation from multiple file formats. Worked extensively on AWS Components such as Airflow, Elastic Map Reduce (EMR), Athena, Snowflake. Build machine learning models to showcase Big data capabilities using Pyspark and MLlib. Migrated an existing on-premises application to AWS. Used AWS services like EC2 and S3 for small data sets processing and storage, experienced in Maintaining the Hadoop cluster on AWS EMR. Used DataStax Spark-Cassandra connector to load data into Cassandra and used CQL to analyze data from Cassandra tables for quick searching, sorting and grouping. Experienced in performance tuning of Spark Applications for setting right Batch Interval time, correct level of Parallelism and memory tuning. Developed python code for different tasks, dependencies, SLA watcher and time sensor for each job for workflow management and automation using Airflow tool Responsible for building scalable distributed data solutions using Hadoop. Developed MapReduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables in the EDW Implemented schema extraction for Parquet and Avro file Formats in Hive. Developed Hive scripts in Hive QL to de-normalize and aggregate the data. Used Spark API over Cloudera Hadoop Yarn to perform analytics on data in Hive. Worked on a POC to compare processing time of Impala with Apache Hive for batch applications to implement the former in project.

Scottsdale, Arizona, United States