Devendra V Email & Phone Number

Boston, Massachusetts, United States

Involved in complete Big Data flow of the application starting from data ingestion upstream to ADLS, processing the data in HDFS and analyzing the data. Developed Scripts for deploying the Pipeline that process the data using the ADF Activities.Collaborated with team members and stakeholders in design and development of data environment.Used airflow Operational Services for batch processing and scheduling workflows dynamically.Worked on performance tuning of data bricks delta tables.Day to-day responsibility includes developing ETL Pipelines in and out of data warehouse, develop major regulatory and financial reports using advanced SQL queries in snowflake.Created Cassandra tables to store various data formats of data coming from different sources.Compiled data from various sources to perform complex analysis for actionable results.

St Louis, Missouri, United States

Related multiple Parent /Child pipelines in ADF using Linked Service/Datasets/Pipeline to extract/Flatten Nested Json Data and load data from Multiple Rest APIs to Azure SQL DB.Good Understanding of Cyber Security Project.Used Stored Procedure to implement Business Logic at ADF Level and Ingest processed data into Tables.Optimized SQL query to improve the performance from 10 minutes to 20 seconds using temp tables.Analysed, Designed and Built modern data solutions using Azure API service to trigger ADF from Frontend UI. Implemented Triggering of ADF from Frontend UI and frequency can be set without ADF /Logic App.

India

Analyze the existing application programs and tune SQL queries using execution plan, query analyzer, SQL Profiler and database engine tuning advisor to enhance performance.Migrated on premise database structure to Confidential Redshift data warehouse.Was responsible for ETL and data validation using SQL Server Integration Services.Wrote various data normalization jobs for new data ingested into Redshift.Implementing and Managing ETL solutions and automating operational processes.Used Kafka functionalities like distribution, partition, replicated commit log service for messaging systems by maintaining feeds and Created applications using Kafka, which monitors consumer lag within Apache Kafka clusters.

India

Created Enterprise Big Data warehouse and imported data from many sources into BDA.Migrated traditional applications into Informatica IDQ using the Big Data cluster and its ecosystem.Transform and analyse data depending on ETL mappings using SPARK and HIVE.Performed ETL and prepared data lakes for diverse domains using DataStage, Informatica BDM.

Master Of Science - Ms, Information Science/Studies

Bachelor Of Technology - Btech, Computer Science