Pavan Kumar P Email & Phone Number

Frisco, TX, US

Dallas, Texas, United States

• Migrated the existing Data from Oracle DB to Snowflake and sourced data from new systems into Snowflake DB.
• Designed ETL Data Flow Architecture from Azure layer to Snowflake involving extraction layer, staging, transformation and warehouse layer.
• Used talend big data components like Hadoop and S3 Buckets and AWS services for redshift.
• Consulting on snowflake data platforms solution architecture design, development and deployment focused to bring the data driven culture across the enterprises.
• Wrote ETL jobs to read from web APIs using REST and HTTP calls and loaded into HDFS using java for redshift
• Created Storage Accounts in Azure and created Azure Service Principals, Key vaults, Access Policies, Firewalls, IAM rules, Containers, File Shares and AKS installations.

Columbus, Ohio Metropolitan Area

• Involved in End-to-End migration of 800+ object with 4TB size from sql server to snowflake.
• Data moved from SQL server Azure snowflake internal stage snowflake with copy options.
• Created roles and access level privileges and taken care of snowflake admin activity end to end.
• Converted 230 views query from SQL server snowflake compatibility
• Retrofitted 500 talend jobs from SQL server to snowflake.
• Worked on SnowSQL and Snowpipe.

Atlanta, Georgia, United States

• Driving replacing every other data platform technology using
• Snowflake with lowest TCO with no compromise on performance, quality and scalability.
• Worked on SnowSQL and Snowpipe
• Designed cloud based Datawarehouse using Snowflake architecture that includes data load using ELT tools like
• Snowpipe that being used for data analytics in dashboarding.
• Developed end to end cloud-based data warehouse which includes loading data from various third party applications.

Atlanta, Georgia, United States

• Extensively used Oracle ETL process for address data cleansing.
• Developed and tuned all the Affiliations received from data sources using Oracle and Informatica and tested with high volume of data.
• Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Oracle and Informatica PowerCenter.
• Created common reusable objects for the ETL team and overlook coding standards.
• Reviewed high-level design specification, EL coding and mapping standards.
• Designed new database tables to meet business information needs. Designed Mapping document, which is a guideline to ETL Coding.

Bengaluru, Karnataka, India

• Developed Spark jobs in Java to perform ETL from SQL Server to Hadoop.
• Designed HBase schema based on data access patterns. Used Phoenix to add SQL layer on HBase table. Created indexes on Phoenix tables for optimization.
• Integrated Spark with Drools Engine to implement business rule management system.
• Benchmarked compression algorithms and file formats (Avro, ORC, Parquet, and Sequence File) for Hive, MapReduce, Spark,
• and HBase.
• Analysed Stored Procedures to convert business logic into Hadoop jobs

Master Of Technology - Mtech, Itms

Bachelor Of Technology - Btech, Computer Science