Pavan Bhagavan Email & Phone Number

Findlay, Ohio, US

Atlanta, GA, US

• Developed Complex ETL pipelines to extract data from Flat Files and load it into EDW and SQl server Database
• Hands-on experience in Azure Data bricks and designing complex notebooks
• Experience as Data Engineer in Azure Big Data Environment
• Expertise in ETL tools i.e. (Informatica)
• Expertise in Implementing Data Warehousing Solutions
• Experience with working in Agile (KANBAN, Scrum ban) environment as part of a scrum team

Atlanta, GA, US

• Analyze, design and build Modern data solutions using Azure PaaS service to support visualization of data. Understand current Production state of application and determine the impact of new implementation on existing.
• Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL and U-SQL Azure Data Lake Analytics. Data Ingestion to one or more Azure.
• Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards.
• Developed Spark applications using Scala and Spark-SQL for data extraction, transformation and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage.
• Responsible for estimating the cluster size, monitoring and troubleshooting of the Spark data bricks cluster.
• Experienced in performance tuning of Spark Applications for setting right Batch Interval time, correct level of Parallelism and memory tuning.

Zurich, Zurich, CH

• Logical and Physical data modeling was done using Erwin for the data warehouse database in STAR SCHEMA
• Using Informatica Power Center Designer analyzed the source data to Extract & Transform from various source systems (oracle 10g, DB2, SQL Server, and flat files) by incorporating business rules using different objects.
• Using Informatica Power Center created mappings and mapplets to transform the data according to the business rules.
• Used various transformations like Source Qualifier, Joiner, Lookup, SQL, Router, Filter, Expression, and Update Strategy.
• Implemented slowly changing dimensions (SCD) for some of the Tables as per user requirement.
• Developed Stored Procedures and used them in Stored Procedure transformation for data processing and have used data migration tools

Frankfurt Am Main, Hessen, DE

• Preparation of high/low level ETL design document.
• Design/Developed mappings/sessions using Informatica power center for data loading.
• Involved in preparation of test scripts and Execution in QA
• Execution of test scripts and bug fixing
• Developed Unix shell scripts for file moving and archival process
• Acknowledged Tickets and Resolved Service center tickets

Madison, NJ, US

• Preparation of high/low level ETL design document.
• Analyzed the stored procedures/packages and implemented code design.
• converted 90% of oracle stored procedures logics into ETL mappings
• Developed mappings/sessions using Informatica power center for data loading.
• Developed mapping for building dynamic SQL statements in Informatica
• Involved in preparation of test scripts and Execution in QA