Data Architect
CurrentDone Security Integration in place Oauth, Network policy for GIT/DBT/Fivetran/HVR/Snowflake end to end1. DBT Cloud Git Integration2. DBT/Fivetran/GitActions Snowflake Integration3. DBT/Fivetran SSO enabling4. Creation of AD groups for DBT/Fivetran/Snowflake 5. Onboarding of user’s to AD group6. Provided privileges to AD groups in DBT/Fivetran/Snowflake based on RBAC7. HVR Hub Server, Agent Install and Configure along with OS authenticaiton and Key pair auth8. Fivetran SSO/SAML setup and RBAC setup9. Federated SQL Integration with SAP DQM, Microsoft SQL, and Oracle via Snowflake ODBC, Snowpark, Python UDFRoles and Resposiblities :1. Setup Snowflake RBAC, Network Policies for Ingress connections2. Design and setup best practices from Data Governance and Privacy on Snowflake Datawarehouse3.Load data into Snowflake via ETL HVR/Fivetran and ELT dbt tools4.Setup Locations, Channels, replicaction tasks on HVR hub for data replication from db2 and SQLServer to S3 Raw zone as Parquet files5.Setup of S3, Glue Catalog, Athena, Policy and Roles for Lakehouse setup6.Working with HVR Capture, Integration, Activation, Refresh jobs, Slicing, Agent config setup7.Snowflake Integration with fivetran, dbt, s3, extrenal stage and volumn setup8. Tuning of HVR job for optimal file creation and copy to snowflake9.Snowflake warehouse setup, tuning, Monitoring, Dashboards etc,10.Data Type conversion best practices between onprem db's and snowflake object migration11.Strong understanding of features of Snowflake to implement Data Quality, Catalog, Data Privacy, Data Share, Marketplace, Zerocopy clone, Timetravel, Security SSO/AD/Oauth/Keypair etc.12.Strong understanding working Snowpipe, Copy, SnowPark, Python UDF, Snow Proc/Functions13.Unload data from Redshift, Snowflake to S3, Data Share, Time Travel etc.14.Build and design of Lakehouse on S3, Iceberg Tables Snow/External Managed Tables, Snow CLI15.Monitoring Usage, Budgetting Snowflake FinOps