Sr. Data Architect
Current• Snowflake Data Architecture Development: Leading the creation, maintenance and enhancements of a layered data architecture for our enterprise data warehouse in Snowflake, incorporating a near-real-time data pipeline. This pipeline, reads data from over 54 mainframe sources via GoldenGate CDC software, Utilizes AWS Lambda as well as Snowpipe for ingestion and implements a complex type 1 processing within Snowflake to ascertain the most current records. This architecture is the foundation of our Snowflake EDW and also serves as a template for other Snowflake data applications/data pipes. • HR Data Integration: Designed and deployed a data pipeline for integrating HR data into Snowflake, which subsequently provided a dual function as an access control lookup mechanism.• Third-Party Vendor Integration: Successfully integrated Snowflake EDW with a wide array of third-party vendors/data providers including Responsys, Optizmo, HubSpot, Click, ServicePower, GreenMountain, UPS, Anaplan, SmartyStreets, RedPrairie, Neustar, Acqueon, Accertify, BrassRing etc, facilitating seamless data interchange and enhancing data utility across the enterprise.• Diverse Data Source Integration: Extended Snowflake EDW’s capabilities by integrating with various data sources such as APIs, flat files, databases, and FTP/SFTP, ensuring a comprehensive data ingestion framework.• Snowflake Library Development ( WIP ): Pioneered the development of Snowflake libraries and modules in Python, aimed at streamlining and accelerating data integration tasks. This initiative has significantly reduced development time, learning curve and increased efficiency in our data engineering processes.• Data Migration Activities: Led enterprise data migration activities from legacy systems to cloud, specifically managing end-to-end complex data migration from Teradata to Snowflake.•Other Collaborations: Collaborated with other teams to make enterprise data available to them.