Kranthi Kumar Email & Phone Number

North Carolina, United States

Minneapolis, Minnesota, United States

- Developed and maintained a Spark Scala framework for ETL processes, efficiently managing data extraction, transformation, and loading to Hive tables or directories.- Utilized JSON files for data operations to ensure quality and accuracy, and configured ECG settings for optimal data ingestion into Blob Storage.- Scheduled and managed production jobs using Airflow, processing client files daily, weekly, and monthly, and implemented ad-hoc jobs for expedited data validation.- Led the migration of code to Azure Databricks, integrating services like Blob Storage, Azure Key Vaults, and Azure Data Factory, and maintained secure credential storage.- Orchestrated data processing by reading JSON files from Blob Storage, executing queries, and loading data into target directories and tables, with API calls via shell scripts for job submissions to Azure Databricks.- Conducted statistical analysis on healthcare data using Python, created various data visualizations, and performed source-to-target count comparisons for data validation.- Configured Spark streaming to receive real-time data from Kafka and store it in HDFS, and optimized query performance by fine-tuning Hadoop and Spark configurations.- Developed and maintained documentation for system configurations, procedures, and troubleshooting guides, and contributed to job monitoring and troubleshooting to resolve production issues.- Created ETL jobs for generating and distributing reports from MySQL databases, and performed capacity planning and scalability assessments for growing data volumes and workloads.- Implemented security measures and access controls to safeguard sensitive healthcare data in compliance with industry regulations, and developed custom UDFs in Hive for specific functions.

Irving, Texas, United States

- Developed batch processing data pipelines using Spark and stream processing with Spark Streaming and Kafka.- Managed large datasets across servers with Apache, enhancing Hadoop algorithms with Spark Context, Spark-SQL, DataFrames, Pair RDDs, and Spark YARN.- Designed and configured Azure Virtual Networks, subnets, DHCP, DNS, security policies, and routing; deployed Azure IaaS VMs and PaaS role instances in secure VNets and subnets.- Implemented high availability for IaaS VMs and PaaS role instances using Azure Internal Load Balancer, Azure Classic, and Resource Manager deployment models.- Developed and maintained .NET websites with ASP.NET MVC, jQuery, HTML, and CSS, improving UX scores by 25% through a smoothing function in a client CAD tool.- Created Spark applications with Spark-SQL in Databricks for data extraction, transformation, and aggregation, uncovering customer usage insights; performed in-memory processing on Hive data with Spark.- Developed REST APIs using Python with Flask and Django, integrating various data sources including Java, JDBC, RDBMS, Shell Scripting, Spreadsheets, and Text files.- Implemented data ingestion and processing frameworks for scalable data platforms; designed Network Security Groups (NSGs) for access control and managed Storage Accounts and Affinity Groups in Azure Portal.- Automated build and deployment processes using Jenkins for Java projects; created a POC for migrating from on-prem Hadoop MapR to Snowflake.- Utilized Agile Scrum methodology to manage a team of four developers with regular code reviews; worked with version control systems like Subversion, GIT, and CVS.

Hyderabad, Telangana, India

• Migrating data from FS to Snowflake within the organization • Imported Legacy data from SQL Server and Teradata into Amazon S3. • Created consumption views on top of metrics to reduce the running time for complex queries. • Exported Data into Snowflake by creating Staging Tables to load Data of different files from Amazon S3. • Compare the data in a leaf level process from various databases when data transformation or data loading takes place. I need to analyse and look into the data quality when these types of loads are done (To look for any data loss, data corruption). • As a part of Data Migration, wrote many SQL Scripts for Mismatch of data and worked on loading the history data from Teradata SQL to snowflake. • Developed SQL scripts to Upload, Retrieve, Manipulate and handle sensitive data (National Provider Identifier Data I.e., Name, Address, SSN, Phone No) in Teradata, SQL Server Management Studio and Snowflake Databases for the Project • Worked on to retrieve the data from FS to S3 using spark commands • Implemented Restful services in Spring.• Serialize and de-serialize objects using Play Json library.• Developing traits and case classes etc in Scala.• Develop quality code adhering to Scala coding Standards and best practices.• Writing complex SQL queries.