Data Engineer
CurrentFor Banking Client• Developed several business-critical ETL processes utilizing Azure Data Factory, Logic Apps, Python, and SQL• Developed SQL Stored Procedures and processes used in client-facing reporting• Updated, debugged, and maintained legacy SQL stored procedures integral for day-to-day functions• Took over and managed team dedicated to client data integration, got the program in a usable state and created a roadmap for improving it using Azure Data lake and Databricks, For Health Tech Client• Created ETL Process using Azure Data Factory for client• Built out Data Lake that utilized Azure Gen 2 Data Lake Storage• Ingested data using ADF Pipelines and custom Python Azure Functions for exception handling and transformation.• Created custom Azure Logic App to automate Email notification based on different triggersFor Health Services Client• Designed Database and Data Warehouse• Developed automated ETL process to populate Data Warehouse• Created customized reporting showing key business metrics for client• Utilized Power BI to reproduce required reports for the client• Used Python and Software 3rd-party API to acquire and load data into DatabaseFor Health Tech Client• Created ETL Process using AWS Glue for client• Built out Data Lake that utilized AWS S3, Athena, and Dynamo• Developed Python scripts using Glue to transform and clean data.• Created custom JSON payload that allowed for greater scalability with new clients and evolving business needs