Pavan K Email & Phone Number

Tempe, Arizona, United States

Designed and implemented scalable data pipelines using Apache Spark and AWS Glue, resulting in aimprovement in data processing times. Collaborated with data scientists and healthcare analysts to develop ETL processes that ensured the accurateintegration of patient data from various sources. Developed and maintained data warehouses on Amazon Redshift, facilitating efficient storage and retrieval oflarge datasets. Implemented data quality checks and validation procedures, leading to a 25% reduction in data errors. Ensured compliance with HIPAA regulations by securing sensitive healthcare data through encryption and accesscontrols.

Los Angeles, California, United States

Utilized Terraform and Cloud Formation to configure EC2 instances with high availability and developedadditional plugins for Terraform to enable support for newly required features. Responsible for designing and implementing data warehousing solutions using Snowflake on AWS to improvethe data processing speed. Actively involved and worked closely with business analysts and other stakeholders to understand theirrequirements and translate them into Snowflake data models and ETL pipelines. Developed and maintained robust data and machine learning (ML) pipelines, leveraging industry best practicesand tools to ensure reliable data processing and analysis.

New Jersey, United States

Installed the Oozie workflow engine to conduct a number of distinct Hive and Pig operations in response to timeand data availability. Streaming systems using Storm and other SQL databases and files using Sqoop were used to import data intoHDFS for Big Data Lake. Using AWS Lambda — AWS’s serverless technology to run functions in the cloud to make functions execute. Deliver static and dynamic files quickly around the world using a Content Delivery Network (CDN). Involved in the Teradata to Snowflake Object Migration. Knowledge of BigQuery, Cloud functions, and GCP Dataproc Using HDFS MapReduce, Kafka, Spark, HBase, Hive,Hive UDF, and Spark to analyze massive and important datasets used the Scala Kafka Consumer API to get datafrom Kafka topics.

New York, United States

Worked on Amazon Redshift to shift all data warehouses into one data warehouse and had a good understandingof Cassandra architecture, replication strategy, gossip, and snitches. Responsible for managing and processing large volumes of data on the AWS cloud platform. Designed and developed Spark applications using Python to handle data from various RDBMS and streamingsources like Kafka.

Bengaluru, Karnataka, India

Used Selenium RC for testing different browser, Selenium Grid for checking instance of server and Selenium IDEfor record and playback. Developed Java test scripts in Selenium for Page Object Framework. Good Experience on Selenium IDE and creating Scripts in selenium --RC by using Java Experience in testing EDI according to HIPAA compliance.

Hyderabad, Telangana, India

Performed extensive data mining and exploration on the virtual and physical server performance log data andconsequently applied anomaly detection algorithm using machine learning tools like R aimed at proactivelydetermining performance issues and reducing downtime. Involved in the administration of the data warehouse using the Warehouse Administrator functionality of SAS. Designed and implemented real-time data integration solutions using Azure Data Factory and Azure Event Hubs. Designed and implemented time series forecasting models for estimating server provisioning on the cloudenvironment which resulted in accurate demand forecasting for cost optimization and budgeting.