Krishna Gonepally Email & Phone Number

United States

United States

In my role as a seasoned Senior Data Engineer with over 10 years of experience, I specialize in transforming business challenges into efficient data solutions. Proficient in Python (PySpark), I design custom UDFs for tasks like row/column manipulations, aggregations, and data cleaning. I leverage scripting languages for ETL procedures on distributed file systems and actively develop solutions using ETL tools, identifying process improvement opportunities.I played a key role in building a data platform from scratch, contributing to performance tuning, and implementing message queuing systems for effective data processing. Notably, I successfully migrated a relational database to a cloud data warehouse, utilizing BI tools for reporting. My expertise extends to data pipelines, Spark applications, and end-to-end development of models for trading compliance.I have a strong background in Dimensional and Relational Data Modeling, employing Star and Snowflake Schemas. Automation proficiency with workflow schedulers and the development of Automation Regression Scripts for ETL validation showcase my efficiency across multiple databases. If you seek a dynamic Data Engineering professional, I am ready to contribute my extensive experience and technical prowess.

Dania, Florida, United States

In my role as a seasoned data professional, I specialize in transforming business challenges into effective data solutions, defining strategies, and roadmaps. Proficient in Spark-SQL, Databricks, and cloud services, I design and implement BI solutions on data platforms. Skilled in ETL, I architect data warehouses and integrate structured data using various tools and methodologies.My expertise extends to serverless computing, multi-cloud environments, and automation with scripting languages. I contribute to master data management projects, manage data lakes, and leverage machine learning for classification models. With a focus on version control and access management strategies, I maintain code repositories for effective collaboration. Experienced in a diverse tech stack, including distributed processing frameworks, message queuing, SQL, and more.

Rochester, Minnesota, United States

I excel in gathering business requirements, developing data cleansing and migration strategies, and Integration and creating ETL jobs in Informatica. With experience in managing Hadoop clusters, I've extended functionality through custom APIs and transformed Hadoop jobs to HBase. My responsibilities include efficient defect fixing, cluster maintenance, monitoring, and commissioning, and I enhance Hive functionality with custom UDFs and UDAFs. Developed and implemented healthcare data integrations to ingest data from external vendors into backend systems, ensuring seamless data flow.I played a pivotal role in implementing a Business Data Warehouse (BDW) that improved query/report performance and established a self-service reporting model in Cognos. Expertise in Hive, Pig, and custom Map Reduce programs allows me to perform data analysis and optimizations. I leverage Python, SAS, and R programming for data extraction, transformation, and loading, ensuring data consistency and efficiency. Worked with healthcare data formats like HL7, FHIR, and EHR systems to integrate clinical data into central repositories.Automated data acquisition processes, improving data integration efficiency using tools such as Python, Pentaho, or Mirth (NextGen Connect).Collaborated in cross-functional teams to automate healthcare data feeds, contributing to scalable integration solutions.Designed and maintained robust data pipelines using Python and integration tools, focusing on performance and scalability.

Hyderabad, Telangana, India

I possess extensive experience in Big Data Analytics within the Hadoop ecosystem, utilizing MapReduce, Spark, Hive, Pig, Sqoop, HBase, Oozie, Impala, and Kafka. Proficient in Oozie pipeline creation, I optimize data latency through parallel processes, working with various data formats like JSON and XML.My expertise includes developing pig scripts for data aggregation and loading, deploying JSON scripts in Azure Data Factory, and connecting to AWS Redshift through Tableau for real-time analysis. I contribute to data management involving OLTP and OLAP, performing UNIX shell scripting, defragmentation, partitioning, compression, and index optimizations for enhanced performance.In collaboration with infrastructure and platform teams, I configure and automate tasks, serving as a vital link between data scientists and platform evolution. My versatile skill set encompasses MapReduce, Spark, Hive, Pig, Sqoop, HBase, Oozie, Impala, Kafka, JSON, XML, PL/SQL, SQL, HDFS, Unix, Python, PySpark, and Azure.

India

Experienced in importing Legacy data from SQL Server and Teradata into Amazon S3, I optimize data consumption views to reduce query running times. Expert in exporting data to Snowflake from Amazon S3 through Staging Tables, I meticulously compare and analyze data quality during transformation and loading processes.As part of Data Migration, I write SQL scripts for data mismatch and handle the history data loading from Teradata SQL to Snowflake. My role involves comparing daily deal items with non-daily deal items to enhance ROI, suggesting improvements, and modifying BI components.Proficient in Functional Testing, Integration Testing, Regression Testing, Smoke Testing, and Performance Testing, I test Hadoop Map Reduce using Python, Pig, and Hive. I create Metric tables and End user views in Snowflake for Tableau refresh, generate Custom SQL for job dependency verification, and work with the Spark ecosystem using Spark SQL and Scala queries on various file formats.In terms of job scheduling, I closely manage Daily, Monthly jobs with Precondition/Postcondition based on requirements, and monitor job performance, providing support in case of failures/issues.