Senior Data Engineer
Current- Clients: University of Florida, General Atlantic, Coralisle Group, U.S. Navy
- Created new data models and data pipelines utilizing Azure Data Factory to help facilitate user driven reporting.
- Created new data warehouse within Snowflake and utilized Matillion to develop data pipelines which fed data into Snowflake.
- Developed brand-new data ingestion system utilizing Apache Airflow to help flow data into a Databricks based warehouse.
- Updated and maintained existing DLT workflows within Databricks while also creating new flows for new emerging use cases.
- Developed new AWS (Lambda, S3, RDS) based invoicing application to replace an existing legacy system.