Data Engineer
Current• Extract structured and semi-structured data from vendors via scripting, REST API, email collection, and queries• Stage and archive data externally and internally using Azure Blob containers, AWS buckets, and Snowflake stages and streams• Transform data with Python or SQL and load into Snowflake• Leverage Snowflake's internal stages, external connections, tasks, and processes to load transformed dataand move to production environments for analysis• Architect and implement new database and schema designs according to business and customer needs• Create, manage, and delegate roles in a development and production environment to provide seamlessaccess for customers while minimizing unnecessary exposure• Write comprehensive python scripts for ETL processes with built in logging and alerting, and schedulethem using Rundeck• Write and troubleshoot web scrapes using Selenium in Python as a form of data extraction• Time sensitive production f ixes for team wide jobs and scripts, managed through process control reportingand team scheduling• Work with a team responsible for ingesting and updating millions of records daily• Apply and update compliance policies across existing pipelines and jobs• Improve security practices by minimizing password exposure, applying RBAC in Snowflake for customersand employees, and managing service account access
