Uday R Email & Phone Number

Negaunee, Michigan, United States

Developed Spark code in Scala and Spark-SQL/Streaming for faster data processing. Created Automation Regressing Scripts in Python to validate ETL processes across multiple databases including AWS Redshift, Oracle, MongoDB, T-SQL, and SQL Server. Worked in AWS environment for development and deployment of custom Hadoop applications. Utilized Python for developing Spark programs, applying functional programming principles to process complex structured datasets. Managed code control using… Show more Developed Spark code in Scala and Spark-SQL/Streaming for faster data processing. Created Automation Regressing Scripts in Python to validate ETL processes across multiple databases including AWS Redshift, Oracle, MongoDB, T-SQL, and SQL Server. Worked in AWS environment for development and deployment of custom Hadoop applications. Utilized Python for developing Spark programs, applying functional programming principles to process complex structured datasets. Managed code control using Git-Bucket and utilized AWS CDK Components like Airflow, Elastic Map Reduce (EMR), and Snowflake.Processed location and segments data from S3 to Snowflake using tasks, streams, pipes, and stored procedures. Show less

Long Beach, California, United States

Utilized Agile methodologies, managing user stories and tasks through Rally tool.Implemented ad-hoc analysis solutions using Data Lake Analytics/Store and HDInsight.Implemented Apache Sentry for access restriction on Hive tables at group level.Proficient in Map Reduce programming using Java, PIG Latin Scripting, and HDFS.Utilized Tidal enterprise scheduler and Oozie Operational Services for cluster coordination and workflow scheduling.Integrated Azure services like Azure… Show more Utilized Agile methodologies, managing user stories and tasks through Rally tool.Implemented ad-hoc analysis solutions using Data Lake Analytics/Store and HDInsight.Implemented Apache Sentry for access restriction on Hive tables at group level.Proficient in Map Reduce programming using Java, PIG Latin Scripting, and HDFS.Utilized Tidal enterprise scheduler and Oozie Operational Services for cluster coordination and workflow scheduling.Integrated Azure services like Azure Data Factory, Azure Data Lake, Azure Data Warehouse, Azure Active Directory, Azure SQL Database, and Web Apps with AWS services for leveraging benefits of both cloud platforms. Show less

Bangalore Urban, Karnataka, India

In my role, I have been actively involved in various aspects of big data analytics and data engineering, adhering to Agile methodologies for development. Utilizing a range of technologies including Spark, Python, and Scala, I have developed Spark jobs on Yarn/MRv2 for interactive and batch analysis, contributing to enhanced performance and optimization of existing algorithms in Hadoop. My responsibilities extend to data movement from on-premises to the cloud in MS Azure, evaluating Apache… Show more In my role, I have been actively involved in various aspects of big data analytics and data engineering, adhering to Agile methodologies for development. Utilizing a range of technologies including Spark, Python, and Scala, I have developed Spark jobs on Yarn/MRv2 for interactive and batch analysis, contributing to enhanced performance and optimization of existing algorithms in Hadoop. My responsibilities extend to data movement from on-premises to the cloud in MS Azure, evaluating Apache Spark's performance in genomic data analysis. Additionally, I have designed and implemented NIFI workflows, performed ETL processes using Python libraries, and migrated data to Azure SQL databases. My expertise also encompasses machine learning modules for Spark jobs, migration of MapReduce programs to Spark RDD transformations, and the orchestration of workflows using Oozie. Furthermore, I have played a pivotal role in recreating application logic in Azure Data Lake and Azure SQL Database, demonstrating proficiency in various tools such as Spark SQL, Kafka, Airflow, and Azure Stream Analytics for real-time data processing. Overall, my comprehensive experience spans diverse technologies and platforms within the realm of big data and analytics. Show less