Kavya C Email & Phone Number

Charlotte, North Carolina, United States

Involved in Agile Scrum development, proficient in Spark scripts on Azure HDInsight for data aggregation, and validation. Skilled in Azure Data Lake Services, Databricks, and Python Notebook formats.Experienced in custom jobs for data ingestion and optimization in Cloudera Hadoop ecosystem using Spark, Scala, and Spark-SQL. Extensively worked with Spark-SQL for data preprocessing. Proficient in architecting medium-to-large scale BI solutions on Azure. Led end-to-end delivery of… Show more Involved in Agile Scrum development, proficient in Spark scripts on Azure HDInsight for data aggregation, and validation. Skilled in Azure Data Lake Services, Databricks, and Python Notebook formats.Experienced in custom jobs for data ingestion and optimization in Cloudera Hadoop ecosystem using Spark, Scala, and Spark-SQL. Extensively worked with Spark-SQL for data preprocessing. Proficient in architecting medium-to-large scale BI solutions on Azure. Led end-to-end delivery of PySpark ETL pipelines on Azure Databricks. Experienced in loading and transforming large sets of structured, semi-structured, and unstructured data. Expertise in Hive, PIG, Impala, Shell Scripting, Perl Scripting, and Python. Proficient in Hive queries for data analysis and creating Hive schemas using partitioning and bucketing. Experienced in data ingestion to Azure Data Storage services using Azure Data Factory, T-SQL, Spark SQL, and U-SQL. Skilled in configuring Hadoop tools like Hive, Pig, Zookeeper, Flume, Impala, and Sqoop. Proficient in Hive Queries for data analysis and creating Hive schemas using partitioning and bucketing. Experienced in recreating existing application logic in Azure environments and utilizing Azure SQL reporting services for report generation. Show less

Englewood, Colorado, United States

Proficient in Hadoop installation and maintenance, skilled in data pipeline configuration, and leveraging ETL tools like Informatica and Python. Experienced in designing effective data systems with Snowflake and Snowflake data modeling. Hands-on experience with AWS Glue, PySpark, and Python automation for data processing.Proficient in Oracle PL/SQL, Shell scripting, and data analysis using SAS tools. Skilled in Spark applications development, Kafka integration, and Sqoop jobs for RDBMS… Show more Proficient in Hadoop installation and maintenance, skilled in data pipeline configuration, and leveraging ETL tools like Informatica and Python. Experienced in designing effective data systems with Snowflake and Snowflake data modeling. Hands-on experience with AWS Glue, PySpark, and Python automation for data processing.Proficient in Oracle PL/SQL, Shell scripting, and data analysis using SAS tools. Skilled in Spark applications development, Kafka integration, and Sqoop jobs for RDBMS data loading.Proficient in SSIS, SSRS, T-SQL, and data modeling using Star and Snowflake Schemas. Conducted PoC for Hadoop-based big data solutions and implemented data stream transformations with Apache Flink. Show less

Urbandale, Iowa, United States

Conducted stakeholder sessions to propose warehouse solutions and developed Python modules for AWS automation. Designed ER diagrams and physical databases for Oracle and Teradata. Imported data using Sqoop to the Data Lake Raw Zone and developed AWS data pipelines using Redshift and EMR. Implemented Hadoop solutions for data processing and managed large datasets with Pyspark and Pandas. Troubleshot data pipeline issues and utilized EMR and Informatica for data transformations… Show more Conducted stakeholder sessions to propose warehouse solutions and developed Python modules for AWS automation. Designed ER diagrams and physical databases for Oracle and Teradata. Imported data using Sqoop to the Data Lake Raw Zone and developed AWS data pipelines using Redshift and EMR. Implemented Hadoop solutions for data processing and managed large datasets with Pyspark and Pandas. Troubleshot data pipeline issues and utilized EMR and Informatica for data transformations. Worked on Oracle to Snowflake migration projects and performed text analytics with Spark. Loaded data into Snowflake from AWS-EMR and utilized NiFi for Snowflake job scheduling. Developed POCs with Spark SQL and MLlib. Show less

India

As a Data Engineer, I build scalable data solutions using Hadoop, participate in Agile development processes, and handle Hadoop installations in Windows and AWS environments.I migrate data warehouses to Snowflake and port Hive code to AWS Big Query. I extract and analyze data from various sources using SQL and PySpark, design data integration programs, and migrate databases to Snowflake. Experienced with Snowflake Multi-Cluster Warehouses, Snowpipe, and Time Travel. I develop… Show more As a Data Engineer, I build scalable data solutions using Hadoop, participate in Agile development processes, and handle Hadoop installations in Windows and AWS environments.I migrate data warehouses to Snowflake and port Hive code to AWS Big Query. I extract and analyze data from various sources using SQL and PySpark, design data integration programs, and migrate databases to Snowflake. Experienced with Snowflake Multi-Cluster Warehouses, Snowpipe, and Time Travel. I develop MapReduce programs, Sqoop scripts, and workflows using Airflow for data transformation and automation.Proficient in setting up Enterprise Data Lakes on AWS and Google Cloud.Experienced in real-time data ingestion using Kafka and Spark streaming. Utilize DMS and Kinesis services for database migration and streaming data processing on AWS. Show less

India

Conducted design discussions and JAD sessions for appropriate data model creation. Performed statistical analysis on healthcare data using Python. Managed performance requirements for OLTP and OLAP databases. Utilized ER/Studio for logical and physical data modeling. Designed ETL data flows optimizing SSIS performance. Collaborated on NiFi workflows for data collection and processing. Implemented tables in Teradata and configured SQL Server Reporting Services. Actively… Show more Conducted design discussions and JAD sessions for appropriate data model creation. Performed statistical analysis on healthcare data using Python. Managed performance requirements for OLTP and OLAP databases. Utilized ER/Studio for logical and physical data modeling. Designed ETL data flows optimizing SSIS performance. Collaborated on NiFi workflows for data collection and processing. Implemented tables in Teradata and configured SQL Server Reporting Services. Actively participated in data mapping and summary table creation for performance improvement. Generated analytical reports and developed T-SQL code for business applications. Led data migration tasks and conducted code reviews for Informatica mappings. Implemented metadata exchange using XML and facilitated design reviews and UAT sessions.Designed physical data models for dynamic reporting and provided user support for loan product applications. Show less