• Involving in designing building, and managing scalable data systems and pipelines to ensure the data accessible, reliable and usable across an organization.• Designing and implementing ETL/ELT pipeline to move and transform data from various sources into target data systems.• Build and automate workflows for batch and real-time data ingestion and processing.• Design and manage scalable, cost-efficient storage solutions for both structured and unstructured data.• Implement strategies for data backup, replication, and disaster recovery.• Process, cleanse, and transform raw data into meaningful formats for analysis.• Orchestrate complex workflows by combining different data services to ensure data pipelines run efficiently.• Responsible for secure data in transit and at rest, ensuring encryption and proper access control.• Responsible for role-based access control (RBAC) and data masking techniques.• Optimize data pipelines for speed, scalability and cost efficiency.• Implement data quality checks and ensure that data integrity is maintained.• Working closely with data scientists, analysts, and business stakeholders to understand data requirements.• Responsible for provision and manage the cloud infrastructure necessary for data engineering workloads.• Responsible for implementing data governance frameworks to ensure data consistency, accuracy and proper documentation.

Project1: Coro• Have done source system Analysis, mapping analysis, and end to end Data lineage analysis.• Have done data profiling and data quality checks.• JSON data extraction, transformation, and data ingestion into Snowflake.• Used Time Travel, Data Retention Settings for Storage for Crucial Tables which helped to analyze the data for testing.• Wrote Snow SQL scripts to achieve the business requirements.• Wrote complex SQL scripts with Joins, Sub Queries, Co-related subqueries, window functions etc.• Migrated legacy transformation code into modular DBT data models.• Written and optimized SQL queries within DBT to enhance data transformation process and improve overall performance.• Utilized DBT to convert raw datasets, enabling efficient analysis and reporting.• UDFs and UDTFs and procedures for transformation into data warehouse facts and dimension tables.• Prepared migration Documents and took the complete responsibility in deployment activities.• Worked with business in UAT and PROD phases to assist on data deliverables.• Worked with Support team to provide the knowledge transfer as part of post-production support.• Involved in analysis, troubleshooting, and fixing the issues.Project 2: Medaware• Have done source system Analysis, mapping analysis, and end to end Data lineage analysis.• Established DBT process to improve performance, scalability and reliability.• Migrated legacy transformation code into modular DBT data models.• Written and optimized SQL queries within DBT to enhance data transformation process and improve overall performance.• Developed ETL pipelines on GCP using Apache Beam and Dataflow to process large-scale data in real-time, resulting in a 20% improvement in data processing time.• Built and deployed data pipelines using Cloud Composer and Cloud Functions, enabling seamless integration with other GCP services such as Big Query, Pub/Sub, and Cloud Storage.

Client: WSI• Developed the Sqoop scripts to make the interaction between Oracle and Hive Database.• Created Hive tables to store processed results in a tabular format.• Have done source system Analysis, mapping analysis, and end to end Data lineage analysis.• Created the hive scripts to load the data from various sources into Hive database.• Developed the Crontab scripts to automate the jobs.• Completely involved in delivering the code end to end.• Involved extensively in data analysis with Tableau reporting tool.• Collaborated with the Support team to transfer knowledge as part of post-production support.• Create ad-hoc data sources to analyze the data and provide solutions to business.• Involved in performance improvement of the queries.

Client:syneos health. Bridgewater, NJ• Converted existing Informatica code into Hive Scripts to transform the data from staging area to Analytics tables.• Fine tune the converted Hive scripts for better performance.• Created Oozie workflow and coordinator for ETL workflow orchestration.• Developed shell scripts to orchestrate the workflow using Oozie shell action.• Created shell scripts for sequential and parallel processing of the tables and adding the dependencies on the tables.• Involved in SIT and UAT testing Phases.• Using the Azure PaaS service, analyze, create, and develop modern data solutions that enable data visualization. • Contributed to the creation of PySpark Data Frames in Azure Databricks to read data from Data Lake or Blob storage and manipulate it using Spark SQL context.

IHG (InterContinental Hotels Group) Rochester, NYProject1: Smart• Developed mappings using various transformations like update strategy, lookup, stored Procedure, Router, Filter, sequence generator, joiner, aggregate transformation, Java, reusable transformations and expression.• Involved in source code review, the mappings created by my team members.• Prepared Migration Document while migration ETL objects and Code from Development to • different environment.• Extensively used Teradata utilities FAST EXPORT, FLOAD, TPUMP, MLOAD, and TPT to load the data to Teradata database.• Involved in creating test scripts.• Developed UNIX scripts involved in this project.• Tuning queries using tools like Explain plan for high efficiency.• Involved in performance tuning by optimizing the sources, targets, mappings, and sessions.• Tested the Informatica mappings with manual testing and assisted the QA team.• Scheduling the jobs using CAWA scheduler in Dev and QA Environments.Project 2: Bowtie• Developed mappings using various transformations like update strategy, lookup, stored Procedure, Router, Filter, sequence generator, joiner, aggregate transformation, Java, reusable transformations and expression.• Involved in source code review, the mappings created by my team members.• Prepared Migration Document while migration ETL objects and Code from Development to different environment.• Involved in creating test scripts.• Developed UNIX scripts involved in this project.• Tuning queries using tools like Explain plan for high efficiency.• Involved in performance tuning by optimizing the sources, targets, mappings, and sessions.• Mappings were designed to cater to the slowly changing dimensions.• Developed various reusable transformations and mapplets that were used in other mappings.• Tested the Informatica mappings with manual testing and assisted the QA team.

US Govt (Insurance) Federal Triangle, WARole & Responsibilities:• Used ETL Informatica tool for extraction, Transformation and loading data into data warehouse.• Informatica code Migrated from 7x to 8x.• Created Sessions, reusable Worklets in Workflow Manager.• Successfully implemented SCDs. Used type2 dimension to keep the history changes.• Involved into source code review, the mappings migrated by my team members.• Created test scripts and involved in deployment activities.• Involved in the preparation of migration Document while migration ETL objects and Code from Development to different environment.• Tested the informatica mappings and assisted QA team