Pavan Bhagavan Email & Phone Number

Findlay, Ohio, Us

Atlanta, Ga, Us

• Developed Complex ETL pipelines to extract data from Flat Files and load it into EDW and SQl server Database• Hands-on experience in Azure Data bricks and designing complex notebooks • Experience as Data Engineer in Azure Big Data Environment• Expertise in ETL tools i.e. (Informatica)• Expertise in Implementing Data Warehousing Solutions• Experience with working in Agile (KANBAN, Scrum ban) environment as part of a scrum team• Programming experience in Python, SQL• Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory • Good understanding of Azure Data bricks platform and ability to build data analytics solutions to support the required performance & scalability • Good understanding and experience working on Delta lake using Apache Delta in Azure Data bricks• Experienced working on performance tuning and optimizing long-running jobs• Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment• Good Understanding of Modern Data Warehouse and Data Warehousing concepts• Excellent written and verbal skills (English)• Created, provisioned multiple Data bricks clusters needed for batch and continuous streaming data processing and installed the required libraries for the clusters.• Extensively used SQL Queries to verify and validate the Database Updates.• Implemented Azure, self-hosted integration runtime in ADF.

Atlanta, Ga, Us

• Analyze, design and build Modern data solutions using Azure PaaS service to support visualization of data. Understand current Production state of application and determine the impact of new implementation on existing business processes.• Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL and U-SQL Azure Data Lake Analytics. Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in In Azure Data bricks.• Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards.• Developed Spark applications using Scala and Spark-SQL for data extraction, transformation and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.• Responsible for estimating the cluster size, monitoring and troubleshooting of the Spark data bricks cluster.• Experienced in performance tuning of Spark Applications for setting right Batch Interval time, correct level of Parallelism and memory tuning.• Hands-on experience on developing SQL Scripts for automation purpose.

Zurich, Zurich, Ch

• Logical and Physical data modeling was done using Erwin for the data warehouse database in STAR SCHEMA• Using Informatica Power Center Designer analyzed the source data to Extract & Transform from various source systems (oracle 10g, DB2, SQL Server, and flat files) by incorporating business rules using different objects and functions that the tool supports.• Using Informatica Power Center created mappings and mapplets to transform the data according to the business rules.• Used various transformations like Source Qualifier, Joiner, Lookup, SQL, Router, Filter, Expression, and Update Strategy.• Implemented slowly changing dimensions (SCD) for some of the Tables as per user requirement.• Developed Stored Procedures and used them in Stored Procedure transformation for data processing and have used data migration tools• Documented Informatica mappings in Excel spread sheet.• Tuned the Informatica mappings for optimal load performance.• Have used BTEQ, FEXP, FLOAD, MLOAD Teradata utilities to export and load data to/from Flat files.• Created and Configured Workflows and Sessions to transport the data to target warehouse Oracle tables using Informatica Workflow Manager.• Have generated reports using OBIEE 10.1.3 for the future business utilities.

Frankfurt Am Main, Hessen, De

• Preparation of high/low level ETL design document.• Design/Developed mappings/sessions using Informatica power center for data loading.• Involved in preparation of test scripts and Execution in QA• Execution of test scripts and bug fixing• Developed Unix shell scripts for file moving and archival process• Acknowledged Tickets and Resolved Service center tickets• Involved in trouble shooting Issues and fixes• Preparation Migration checklist• Involved in Migration of codes • Handled Team size of three.

Madison, Nj, Us

• Preparation of high/low level ETL design document.• Analyzed the stored procedures/packages and implemented code design.• converted 90% of oracle stored procedures logics into ETL mappings• Developed mappings/sessions using Informatica power center for data loading.• Developed mapping for building dynamic SQL statements in Informatica• Involved in preparation of test scripts and Execution in QA• Execution of test scripts and bug fixing• Developed Unix shell scripts for findings number of columns in a data file• Developed Unix shell scripts, for finding files older than n days• acknowledged Tickets and Resolved Service center tickets• Involved in trouble shooting Issues and fixes• Preparation Migration checklist• Involved in Migration of codes • Meeting Service Line agreements