Pavan Kumar P Email & Phone Number

Frisco, Tx, Us

Dallas, Texas, United States

• Migrated the existing Data from Oracle DB to Snowflake and sourced data from new systems into Snowflake DB.• Designed ETL Data Flow Architecture from Azure layer to Snowflake involving extraction layer, staging, transformation and warehouse layer.• Used talend big data components like Hadoop and S3 Buckets and AWS services for redshift.• Consulting on snowflake data platforms solution architecture design, development and deployment focused to bring the data driven culture across the enterprises.• Wrote ETL jobs to read from web APIs using REST and HTTP calls and loaded into HDFS using java for redshift• Created Storage Accounts in Azure and created Azure Service Principals, Key vaults, Access Policies, Firewalls, IAM rules, Containers, File Shares and AKS installations.• Created Audit Framework using Snowflake procedures to generate and align the publication from source tables to warehouse table to track the records from the same batch.• Created Data Reconciliation policies to ensure the data accuracy from source to target.

Columbus, Ohio Metropolitan Area

• Involved in End-to-End migration of 800+ object with 4TB size from sql server to snowflake.• Data moved from SQL server Azure snowflake internal stage snowflake with copy options.• Created roles and access level privileges and taken care of snowflake admin activity end to end.• Converted 230 views query from SQL server snowflake compatibility• Retrofitted 500 talend jobs from SQL server to snowflake.• Worked on SnowSQL and Snowpipe.• Used the UNIX for automatic scheduling of jobs, involved in unit testing of newly created PL/SQL blocks of code.• Worked on EDW modules by retrieving the data from the different source systems databases like DB2, Oracle, Netezza, MS SQL Server, Flat files and then loading it into target databases of Netezza/ MS SQL Server databases using IBM data stage Parallel jobs.

Atlanta, Georgia, United States

• Driving replacing every other data platform technology using• Snowflake with lowest TCO with no compromise on performance, quality and scalability.• Worked on SnowSQL and Snowpipe• Designed cloud based Datawarehouse using Snowflake architecture that includes data load using ELT tools like• Snowpipe that being used for data analytics in dashboarding.• Developed end to end cloud-based data warehouse which includes loading data from various third party applications.• Created Snowpipe, databases, schemas, objects, UDFs and Shares using Snowflake.• Designing and working on proof of concept for integrating new bolt on applications.• Supporting and ensuring smooth deployment of releases.• Converted Talend Job lets to support the snowflake functionality.• Created data sharing between two snowflake accounts(Prod — Dev). Redesigned the Views in snowflake to increase the performance.• Unit tested the data between S3 and Snowflake.

Atlanta, Georgia, United States

• Extensively used Oracle ETL process for address data cleansing.• Developed and tuned all the Affiliations received from data sources using Oracle and Informatica and tested with high volume of data.• Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Oracle and Informatica PowerCenter.• Created common reusable objects for the ETL team and overlook coding standards.• Reviewed high-level design specification, EL coding and mapping standards.• Designed new database tables to meet business information needs. Designed Mapping document, which is a guideline to ETL Coding.• Used ETL to extract files for the external vendors and coordinated that effort.• Migrated mappings from Development to Testing and from Testing to Production.• Performed Unit Testing and tuned for better performance.• Created various Documents such as Source-to-Target Data mapping Document, and Unit Test Cases Document.• Read data from flat files and load into Database using SQL Loader.• Developed Logical and Physical data models that capture current state/future state data elements and data flows using Erwin 4.5.• Responsible for design and build data mart as per the requirements.• Extensively worked on Views, Stored Procedures, Triggers and SQL queries and for loading the data (staging) to enhance and maintain the existing functionality.

Bengaluru, Karnataka, India

• Developed Spark jobs in Java to perform ETL from SQL Server to Hadoop.• Designed HBase schema based on data access patterns. Used Phoenix to add SQL layer on HBase table. Created indexes on Phoenix tables for optimization.• Integrated Spark with Drools Engine to implement business rule management system.• Benchmarked compression algorithms and file formats (Avro, ORC, Parquet, and Sequence File) for Hive, MapReduce, Spark,• and HBase.• Analysed Stored Procedures to convert business logic into Hadoop jobs• Used SSIS and SSRS for BI projects• Worked on various POCs including Apache NiFi as a data flow orchestration engine, Talend as ESB and Big Data solutions, Elasticsearch as an indexing engine for MDM, and SMART on FHIR with MongoDB for FHIR based app interface.• Used Cassandra to build next generation storage platform. Employed CQL for data manipulation.

Master Of Technology - Mtech, Itms

Bachelor Of Technology - Btech, Computer Science