Revanth A Email & Phone Number

Little Elm, Tx, Us

San Francisco, California, United States

• Experience in building and architecting multiple Data pipelines, end to end ETL and ELT process for Data ingestion and transformation in AWS.• Implemented a Continuous Delivery pipeline with Docker and Git Hub.• Worked with g-cloud function with Python to load Data into Redshift for on arrival csv files in S3 bucket.• Devised simple and complex SQL scripts to check and validate Dataflow in various applications.• Performed Data Analysis, Data Migration, Data Cleansing, Transformation, Integration, Data Import, and Data Export through Python.• Performed data engineering functions: data extract, transformation, loading, and integration in support of enterprise data infrastructures - data warehouse operational data stores and master data management.• Responsible for data services and data movement infrastructures good experience with ETL concepts, building ETL solutions and Data modeling.• Architected several DAGs (Directed Acyclic Graph) for automating ETL pipelines.• Hands on experience on architecting the ETL transformation layers and writing spark jobs to do the processing.• Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, writing applications).• Imported data from AWS S3 into Spark RDD and performed actions/transformations on them.• Created Partitions, Bucketing and Indexing for optimization as part of Hive data modeling.• Involved in developing Hive DDLs to create, alter and drop Hive tables.• Worked on different RDDs to transform the data coming from different data sources and transform the data into required formats.• Created data frames in SPARK SQL from data in HDFS and performed transformations, analyzed the data and stored the data in HDFS.• Worked with Spark Core, Spark Streaming and Spark SQL modules of Spark for faster processing of data.• Developed Spark code and Spark SQL for faster testing and processing of Realtime data.

Denton, Texas, United States

Hyderabad, Telangana, India

Hyderabad, Telangana, India

Hyderabad, Telangana, India

Hyderabad, Telangana, India

Master'S Degree

Bachelor'S Degree