Senior Data Engineer
CurrentClients: University of Florida, General Atlantic, Coralisle Group, U.S. Navy ● Created new data models and data pipelines utilizing Azure Data Factory to help facilitate user driven reporting.● Created new data warehouse within Snowflake and utilized Matillion to develop data pipelines which fed data into Snowflake.● Developed brand-new data ingestion system utilizing Apache Airflow to help flow data into a Databricks based warehouse.● Updated and maintained existing DLT workflows within Databricks while also creating new flows for new emerging use cases.● Developed new AWS (Lambda, S3, RDS) based invoicing application to replace an existing legacy system.