Karthik E Email & Phone Number

Bentonville, Arkansas, United States

•Analyzed the existing application programs and tune SQL queries using execution plan, query analyzer, SQL Profiler and database engine tuning advisor to enhance performance.•Implementing and Managing ETL solutions and automating operational processes.•Used Kafka functionalities like distribution, partition, replicated commit log service for messaging systems by maintaining feeds and Created applications using Kafka, which monitors consumer lag within Apache Kafka clusters.•Created Data Quality Scripts using SQL and Hive to validate successful das ta load and quality of the data. Created various types of data visualizations using Python and Tableau.

North Carolina, United States

•Used SparkSQL to load JSON data and create Schema RDD and loaded it into Hive Tables and handled structured data using SparkSQL.•Developed Spark programs with Python and applied principles of functional programming to process the complex structured data sets.•Worked with Hadoop ecosystem and Implemented Spark using Scala and utilized Data frames and Spark SQL API for faster processing of data.•Designed and developed Real Time Stream Processing Application using Spark, Kafka, Scala and Hive to perform Streaming ETL and apply Machine Learning.

Plano, Texas, United States

•Integrating Scala code into CI/CD pipelines, as well as automating build, testing, and deployment procedures with tools like as Jenkins, GitLab CI, and Travis CI.•Involved in complete Big Data flow of the application starting from data ingestion upstream to HDFS, processing the data in HDFS and analyzing the data and involved.•Developed MapReduce Programs using Apache Hadoop for analyzing the big data as per the requirement.•Performed Day to-day responsibilities which includes developing ETL Pipelines in and out of data warehouse, develop major regulatory and financial reports using advanced SQL queries in snowflake.

Deerfield, Illinois, United States

• Developed ETL programs using Informatica to implement the business requirements.• Communicated with business customers to discuss the issues and requirements.• Implemented Type II slowly changing dimension to maintain historical information in dimension tables• Improved the performance of the existing process to a major portion by creating Database partition which will help to insert/update million records• Used various transformations like Source Qualifier, Expression, Aggregator, Joiner, Filter, Lookup, Update Strategy Designing and optimizing the Mapping.• Developed Workflows using task developer, worklet designer, and workflow designer in Workflow manager and monitored the results using workflow monitor. Created various tasks like Session, Command, Timer and Event wait.

Hyderabad, Telangana, India